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AN ANALYSIS OF CERTAIN PSYCHOLOGICAL TESTS USED FOR 
THE EVALUATION OF BRAIN INJURY* 


I. INTRODUCTION 


NE TYPE Of battle casualty which has 

had increasing attention in both 
medicine and psychology is brain in- 
jury. The problems of diagnosis, symp- 
tomatology (mental and physical), re-edu- 
cation, and rehabilitation are of the 
utmost importance. Each of these prob- 
lems, to some extent, falls into the field 
of clinical psychology. Through the 
proper use of existing measures the clini- 
cal psychologist can aid in: (1) Differ- 
ential diagnoses; (2) The estimation of 
previous and present levels of capability; 
(3) The determination of personality 
dysfunction; (4) The-detection of specific 
losses in mental efficiency; and (5) The 
development of a program for re-educa- 
tion and rehabilitation. This does not 
mean that all of the psychological ques- 
tions regarding brain injury have been 
answered, Research is particularly needed 
‘n explaining the biological-psychological 
relationships of behavior manifested by 
brain injured persons. 

The collation of data obtained through 
the analysis of different psychological 
measures administered to various types 
of mental entities furthers test develop- 
ment. The new approaches thus provided 
make it possible to assemble a more com- 
plete and accurate clinical picture, It 
is only through the constant application 
of the experimental technique that clini- 
cal psychology can keep abreast of its 
rapidly expanding scope. 

Clinical psychology has advanced be- 
yond the state of mere quantitative 

* We are indebted to Captain J. A. Aita, M.C., 
AUS, for neurological evaluation of brain in- 
jured cases used in this paper, and to Mr. 


Ralph M. Reitan for contributing those sections 
of the paper dealing with the Rorschach findings. 
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measurement of specifically defined traits 
and abilities. The considerations neces- 
sary in the field are rapidly approaching 
the goal of understanding the interrela- 
tionships of human characteristics. Re- 
cent studies by Rapaport (23) indicate 
that the trend in psychological investiga- 
tion is toward the evaluation of individ- 
ual test results as a part of a behavioral 
picture. For example, the data obtained 
from the Wechsler-Bellevue (32) is no 
longer considered a mere indicator of 
intellectual level alone, but is also of 
assistance in the detection of specific 
personality maladjustments and the pres- 
ence of possible organic cerebral altera- 
tion. The use of projective techniques 
such as the Rorschach (25) and the The- 
matic Apperception Test (21) are further- 
ing the clinical psychologist’s apprecia- 
tion of the value in understanding the in- 
dividual as an integrated whole. With this 
concept as a frame of reference, perhaps 
something can be gained by re-examining 
the previously mentioned uses of clinical 
psychology insofar as the brain injured 
individual is concerned. 

The estimation of the level of capa- 
bility and the determination of specific 
functional losses will be discussed to- 
gether. As Goldstein has discussed in 
detail, the IQ is often misleading and 
is of limited value in cases of brain in- 
jury (8). A full scale score obtained from 
such measures as the Wechsler Mental 
Abilities Scale (Form B) (or MAS) (33) 
or the Wechsler-Bellevue (32), however, 
does provide a good estimation of an 
individual’s position in relation to the 
general population. It serves as a base 
line against which impairment can be 
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measured, and also as a rough estimate 
in evaluating the brain injured patient's 
general capability for future job place- 
ment. However, the IQ has all of the 
disadvantages of any mean as it gives 
very little indication of the actual status 
of the components which make up the 
average. The assumption that al] intel- 
lectual functions measured contribute 
equally to the total result is a hypotheti- 
cal consideration. Actually, as every cli- 


TABLE I 


A partial Wechsler-Bellevue record of a 
severely brain damaged patient 








Weighted 
Score 


Tests 





Information 
Comprehension 
Arithmetic 
Digit Span 
Similarities 
Verbal Score 
Picture Completion 
Picture Arrangement 
Object Assembly 
Block Design 
Digit Symbol 
Performance Score 
Total Score 
Verbal Score 31—IQ—83 
Performance Score 15—IQ—66 
Full Scale Score 46—IQ—73 
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nician knows, there is nearly always a 
degree of sub-test scatter. Thus it be- 
comes necessary to evaluate the IQ in 
terms of the sub-test, especially when 
dealing with brain damaged patients. 
A partial Wechsler-Bellevue (32) record 
of a brain injured patient is given in 
Table 1. On the basis of the total score 
the assumption may be made that the 
patient was operating on a border-line 
defective level. Omitting those scores that 
have been found to be relatively un- 
affected by post-traumatic brain injury 
(1), it is apparent that the obtained IQ 
is not adequate evaluation of the pa- 
tient’s intelligence. The IQ considered 
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in isolation is only a single and often 
unreliable segment of the total behav- 
ioral pattern. 

In the diagnosis of personality dis- 
orders certain clinical tests are extremely 
helpful. In many cases by the proper 
use of certain of them it is not only pos- 
sible to label the disorder but, through 
such projective techniques as the The- 
matic Apperception Test (21), the cause 
may be indicated. However, in deter- 
mining the presence of brain damage, it 
is extremely doubtful that any psycho- 
logical measure will approach the va- 
lidity of the pneumo-encephalogram, 
surgeon’s reports, and neurological find- 
ings. The most important consideration 
of psychological testing is not to give a 
positive or negative statement as to the 
presence of cerebral alteration. The pri- 
mary concern of the psychologist should 
be to discover personality or behavioral 
changes typical of brain injury and deter- 
mine their influence upon future adjust- 
ments, Rather than to attempt a diag- 
nosis of the presence of brain injury, 
psychological tests should attempt to 
answer questions such as: (1) Has the 
injury created a definite loss in intel- 
lectual functioning? (2) What specific 
abilities have been retarded? (3) Has the 
personality structure undergone changes, 
either of a temporary or a permanent 
nature? (4) To what extent are education 
and rehabilitation possible? (5) Where 
will the patient fit into the social struc- 
ture in the future? It is the opinion of 
the writer that too much emphasis in 
clinical psychology has been placed on 
the diagnostic aspect and too little on 
the points enumerated above. This pos- 
sibly has been a consequence of a differ- 
ent scale of values which had to be 
adopted during the war period. The 
press of psychological casualties of all 
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types incteased the importance of correct 
classification. This is a trend away from 
the concept of total behavior, and a 
readjustment of attitude and thinking 
should occur to insure the continued 
advance of clinical psychology. 
Although re-education and rehabilita- 
tion are not topics to be discussed in this 
paper, they are of vital concern to the 
brain injured patient. He is faced with 
such problems as the ability to earn an 
adequate living wage and to otherwise 
make an adequate social adjustment. 
Consequently a great deal of worry and 
anxiety occurs which, if left unheeded, 
may develop into a definite neurosis. As 


a preventative measure there has been 
instituted a program of occupational 
therapy in all military hospitals. Keeping 
the patient occupied is sound practice 
and has been exceptionally fruitful. In 
conjunction with occupational therapy, 
educational reconditioning classes are 
conducted. They provide instruction in 
such trades as radio, mechanics, carpen- 
try, etc. and use the facilities of the 
United States Armed Forces Institute. 
The extent to which these programs will 
succeed for the individual brain injured 
patient is determined to a large degree 
by the recommendations of the clinical 
psychologist. 





II. WHat Is THE BRAIN INJURED PATIENT LIKE? 


N AN excellent review of the literature, 

Klebanoff (17) has collated a vast 
amount of previously published data in 
an attempt to determine the psychologi- 
cal residuals of brain damage. In reading 
the article one is impressed with the 
fact that conclusions have been drawn 
from relatively limited samples and that 
questionable tests and testing techniques 
have been employed. These deficiencies 
are clearly indicated in his conclusions: 
“It is felt that experimental progress 
demands the satisfaction of two methodo- 
logical considerations. First . . . must 
involve comparisons between . . . organic 
brain disorders and normal persons. 
Second . . . specialized test development 
should be directed toward the various 
spheres of possible psychological impair- 
ment”, Certainly these aims are basic. 
However, there are other aspects that 
should not be overlooked. One of these 
is the source of the injury. The brain 
injured cases to be considered in this 
paper all suffered post-traumatic injuries. 
In a recent publication an exhaustive 
inquiry has been made into this type of 
injury. Two of the contributors, Gurd- 
jian and Webster (10) present a study 
of a variety of experimentally produced 
head injuries, The means of creating the 
damage roughly corresponds to the source 
of most of the injuries received by the 
patients to be considered in this publi- 
cation. In general their results point to 
the difficulty involved in determining 
whether an injury is of a focal or diffuse 
nature. Of the patients used in the pres- 
ent study who were known to have defi- 
nite cerebral injury, only 12% were con- 
sidered to be purely focal by the neurolo- 
gist. The others were classed either as 
focal-diffuse or diffuse. Because of the 
nature of our case material we are not 


in a position to attempt a correlation 
of behavioral changes with injury to a 
specific cortical area. It is our opinion 
that this can be attempted only when 
dealing with pure focal surgical lesions 
similar to those reported by Freeman and 
Watts (7). 

Another consideration is the presence 
or suspected presence of personality al- 
teration. If such changes have occurred, 
how do they affect the psychological test 
results? It is very likely that some of the 
indications given by the tests may be due 
to personality dysfunction ' precipitated 
by the injury and not to cerebral damage. 
Experimentally this distinction becomes 
important, Again it will not be possible 
to give any conclusive statements in this 
respect. All evidence will of necessity be 
indirect or comparative as our case rec- 
ords indicate little of the personality 
structure or adjustments of the indi- 
vidual patients before the injuries oc- 
curred. The study of Freeman and Watts 
(7) is one of the few that has been ade- 
quately controlled in this sense. In addi- 
tion their cases are being followed up 
and from such procedure much valuable 
data should be obtained. 

The final point is the necessity of 
comparing the test results of the brain 
injured patient with results from groups 
of patients representing all other types 
of mental disorders. It is of importance 
to ascertain whether the performance of 
a brain damaged patient is characteristic 
or similar to that obtained, for example, 
from a schizophrenic. Only by means of 
such a technique can the question of test 
validity be completely settled. 

With all of these points as a back- 


ground, it is our purpose to consider the ’ 


post traumatic brain injured patient from 
the standpoint of intellect and affect. 
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A. INTELLECT 

It is difficult to estimate pre-injury 
intellect but it has been noted that cer- 
tain Wechsler-Bellevue and MAS items 
such as vocabulary and information ap- 
pear to remain approximately at their 
previous level (1). Using these items as 
base lines and comparing the results of 
the remaining sub-tests to them it is 


shown in Table 2. Slightly more than 
half of those patients who had suffered 
definite injury had an accompanying 
definite intellectual loss according to our 
measurements. Certainly the failure of 
47% of the patients to show any retarda- 
tion requires explanation. The following 
variables, any one of which might ac- 
count for the above results, are presented 


TABLE 2 


Intellectual changes followin 
as indicated by the 


g post traumatic brain injury 
AS and Rorschach 








Patients Maintaining 
Previous Level 


Patients Below 
Previous Level 





Previous Level N 


% % 





Above average 13 
Average 37 
Below Average 10 


31 69 
54 46 
40 60 





Total 60 








47 53 





possible to determine roughly the extent 


of intellectual loss: However, this tech- 
nique is not completely valid. Hunt (15) 
lists a number of methodological criti- 
cisms and Babcock (5), who is largely re- 
sponsible for this method, indicates that 
vocabulary suffers when the deterioration 
is severe. In order to obtain as accurate 
an estimate as possible, the findings from 
the MAS and the Rorschach were col- 
lated. This method curtailed the size of 
the sample but lent credence to the as- 
sumed pre-injury mental level. As an 
added check the prior AGCT [Army 
General Classification Test] scores were 
utilized and, although not intelligence 
measures, they were of value. The 
Rorschach data is of exceptional interest. 
When combined with the MAS results 
it is not only possible to get indications 
of pre-and post-injury ability, but further 
information is gained regarding the 
efficiency with which this ability is being 
utilized, the amount of drive, and the 
present affective picture. The results are 


for consideration: (1) Injuries to certain 
cortical areas may not be followed by 
losses in mental ability: (2) The severity 
and/or type of trauma and the severity 
and/or type of consequent injury may 
have been responsible; (3) Previous in- 
telligence level, degree of education or 
training, and cultural or occupational 
background may have masked actually 
existing changes; (4) Inaccuracies in esti- 
mating the previous intelligence level 
may have occurred; (5) The tests them- 
selves may have been too restricted; that 
is, all functions and/or areas of possible 
impairment may not have been tapped; 
(6) Malingering, either on a conscious or 
unconscious level may have been a factor; 
(7) Closely allied to the above are the 
possible effects on the test results of affec- 
tive dysfunction; and (8) Perhaps the 
effects of the injury were transitory and 
improvement before the patient was 
tested was sufficient to erase any pre- 
viously existing losses. 

As has already been indicated, the 
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case material studied was such that it 
was impossible to relate specific areas of 
injury to changes in intellect or affect. 
The sample was divided into the broad 
categories of mild, moderate, and severe 
injury. The results of this breakdown 
are shown in Table 3. The number of 
cases in the sub-groups are much too 
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indicated by the data. The technique is 
crude and only outstanding generalized 
retardation can be readily determined. 
Whether the tests used were adequate is 
a point that only further experimenta- 
tion can definitely establish. Previous in- 
vestigations have shown them to be of 
some value (1). 


TABLE 3 
The composition of the groups shown in Table 2 in respect to mild, 
moderate and severe brain injuries 








Group Number 


Mild Mod. Severe 





Above Average 
Average 18 
Below Average 3 


Total 








small to be of definite significance. Only 
in the total group with severe injuries 
did any relationship exist between the 
extent of injury and reduction in intel- 
lect. These results do not include con- 
sideration of the type (focal, focal-diffuse, 
diffuse) or area of the injury. The com- 
position of the intelligence groupings 
shown in Table 2, in respect to type, 
were found to be virtually identical. 

The training, educational, cultural, 
and occupational backgrounds, although 
not identical were not too dissimilar. 
However, all of these data were obtained 
directly from the patients with the exist- 
ing possibility of inaccurate statements. 
No reason for falsification of this in- 
formation by the subjects was apparent, 
however, and we believe that the data 
are fairly accurate. 

The estimation of the previous intel- 
ligence level leaves much to be desired. 
The categories into which the patients 
were divided are too broad to allow the 
detection of limited changes. Therefore, 
changes may be present which are not 


Percent of Mild, 
Mod., Severe Retain. 

Previous Level 

Mild Mod. Severe 


Percent of Mild, 
Mod., Severe Below 

Previous Level 

Mild Mod. Severe 





71 67 ° 29 33 ° 
39 22 80 61 78 20 
67 67 ° 33 33 


100 





48 73 5° 52 27 





Malingering is difficult to prove. How- 
ever, as all tests were given individually, 
it is our opinion that it did not occur 
on a conscious level. The possibility was 
present of unconscious evasion as a result 
of an affective maladjustment but if it 
was present the extent was impossible 
to determine. 

A series of articles by Ruesch (26), 
Ruesch and Moore (27), and Moore and 
Ruesch (20) indicates that improvement 
in mental ability does occur after brain 
injury particularly during the first few 
weeks. Inasmuch as most of our tests 
were given six months after injury this 
may partially account for the high per- 
centage of subjects whose _ post-injury 
test results classified them in the same 
intelligence range as their estimated pre- 
injury intelligence, 

To summate, it is evident that there 
are too many indeterminate variables 
present to allow any conclusive state- 
ments as to the effects of brain injury 
on intelligence. All that can be concluded 
is that some of the patients did undergo 
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definite measurable mental alteration. 
The specific functions that appear to be 
most vulnerable have been considered in 
a previous study (1). 


>e Bit: 


B. AFFECT 


Affective disorders occurring after head 
injury have been noted and described by 
various writers. One of the earliest of 
these was Adolph Meyer, who in 1904 
published an article (19) in which he 
described the sequelae as usually con- 
sisting of prolonged periods of confusion 
with hallucinatory episodes and subse- 
quent recovery. He also noted that other 
disturbances were frequently present, 


such as impaired retentive memory, re- 


tardation in the flow of thought, extreme 
fatiguability, irritability, headaches, and 
intolerance to alcohol. Schilder pub- 
lished a significant paper in 1934 (28), 
in which he discussed disturbances rang- 
ing from-temporary confusion following 
injury to a catatonic picture which was 
still present at a recheck after the patient 
had been discharged from the hospital. 
The patients that we have studied were 
admitted to the hospital usually from 
three to six months following injury, 
and therefore we will not discuss the 
temporary confusion and disorientation 
immediately following recovery of con- 
sciousness. Rather, we will be concerned 
in this section with describing affective 
disorders which either develop after the 
injury or are semi-permanent in nature. 
In another study (2), we have noted 
certain disturbances which are frequently 
present among persons who have suffered 
head injury. Rorschach’s test indicated 
that anxiety, depressive tendencies and 
hypochondriasis were often present. Oc- 
casionally records gave indications which 
were markedly schizophrenic-like in na- 
ture. Emotional control was not signifi- 
cantly impaired, according to the Ror- 


schach findings, except among patients 
with severe injuries. 

Schilder has found substantially the 
same group of symptoms (29), consisting 
of anxiety, hysteria, and hypochondriasis 
among the frequent post-injury neurotic 
disturbances. He believes that these dis- 
orders arise largely from the psychic 
value of the head and from neurotic 
tendencies present before injury. The 
“‘post-concussion syndrome” he believes 
to be on an organic basis, although an 
intricate picture soon develops because 
the organically based disturbances ac- 
centuate the development of ncurotic 
overlay. 

Study of our patients had indicated 
that the “psychic value” of the head is 
an important factor in the development 
of neurotic disturbances. As an example 
it may be interesting to consider one 
case specifically. This patient received 
a moderately severe, penetrating, left 
parietal injury, After recovery of con- 
sciousness he was confused and dis- 
orientated. Gradually he recovered his 
ability to think clearly and when he was 
admitted to our. hospital, four months 
later, showed no signs of mental con- 
fusion. He had developed left hemiplegia 
following injury, which was present at 
this time. The W-B indicated that he was 
of low superior intelligence. 

After several discussions with one of 
the writers the patient told of the de- 
velopment of anxiety and lack of per- 
sonal confidence following injury. He 
was aware of the confusion and dis- 
orientation that had been present after 
the injury. He had no idea how the head 
injury would affect his future adjustment. 
Perhaps due to prior misinformation, he 
suspected that his behavior would be 
peculiar and that he would not be able 
to recognize these peculiarities. He did 
not place much confidence in what the 
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doctors told him concerning his psycho- 
logical adjustments, because he thought 
that they were probably withholding in- 
formation, supposedly for his own good. 
Therefore he decided to try an experi- 
ment. He selected the patient on his 
ward whom he considered to be most 
intelligent, and began developing a close 
friendship with this person. After they 
had been with one another almost con- 
stantly for about two weeks, the patient 
who devised the experiment, confiden- 
tially asked the other patient if he had 
noticed anything peculiar about his be- 
havior, explaining that he wanted to 
face the truth. He was informed that 
nothing queer had been noticed. Again 
he suspected that his feelings were being 
shielded. Only after a strong relationship 
of confidence had been developed be- 
tween the patient and one of the writers, 
was he convinced that his behavior was 
not peculiar. 

We have seen neurotic disturbances 
arise in this manner in a number of in- 
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stances, and feel that such disorders 
should be carefully guarded against and 
watched for in the treatment of brain 
injured patients. 

It is important to stress the arisal of a 
lack of personal confidence among brain 
injured persons. As in the specific case 
mentioned, they often doubt their ability 
to behave and think properly. There is 
frequently a deep-seated fear that things 
have changed, that they are not the per- 
sons they were before they were injured. 
This is reflected in anxious, cautious, 
guarded behavior. 

In our opinion, affective disturbances 
following head trauma arise as a mani- 
festation of the intricate interplay of 
organic and functional factors. Intel- 
lectual impairment, caused by actual 
destruction of cortical tissues, may be a 
factor eliciting neurotic disturbances. 
Further, it has been concluded in several 
other studies that a head injury may 
elicit or precipitate neurotic or psychotic 
predispositions. 





III. Critique oF TEsts PReviousty Usep 


N PREVIOUs studies (1, 2) the Wechsler 

Mental Ability Scale (Form B) 
(MAS), the Rorschach, Shipley-Hartford- 
Retreat Scale for Intellectual Impair- 
ment and the Hunt-Minnesota test for 
Organic Brain Damage were considered 
in respect to their value as diagnostic 
aids in the determination of brain in- 
jury. Inasmuch as these studies were of 
a largely quantitative nature, it is our 
purpose in this paper to review critically 
each of these tests, irrespective of its 
diagnostic value, considering the com- 
parative advantages, disadvantages and 
rationale of each. The MAS has been 
discussed in preference to the more 
widely used W-B for the following rea- 
sons: (1) The majority of the brain in- 
jured patients had been administered the 
MAS; (2) The MAS was extensively used 
during the war but little has been re- 


ported as to its value as a diagnostic 
instrument; (3) The MAS and the W-B 
are so similar that in general the same 
criticisms apply, especially since the ap, 
proach to be made does not take specific 
item differences into acount. 


A. THE WECHSLER MENTAL 
ABILITY SCALE 


The MAS, although diagnostically 
more valuable than either the Hunt or 
the Shipley, had certain undesirable 
features which became evident when 
dealing with brain injured patients. Ob- 
servations by the writers and others in 
clinical situations indicate that for a 
considerable period of time following the 
brain damage the patients fatigue rapidly 
when confronted with any task involving 
mental effort (1). The MAS, using 10 
sub-tests, was found to be much too long 
to be used as a “one session” screening 
device. The reasons are obvious; exces- 
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sive fatigue would have a definite effect 
on future rapport and the obtained IQ 
or mental age would be unreliable. 
Several methods were tried in an attempt 
to offset this disadvantage. (1) The test 
was divided and given in two periods. 
However, “test splitting” is undesirable 
procedure. As pointed out by Rapaport 
(23), “when a subject takes an intelligence 
test, his performance represents his ef- 
ficiency of functioning then and there.” 
If the test is given in two different peri- 
ods, the subject’s efficiency may be at 
different levels, and thus introduce an 
added variable which cannot be ade- 
quately evaluated in interpretation. (2) 
A shortened form of the MAS was used. 
The value of this procedure will be dis- 
cussed later. (3) Several short interviews 
were held before any actual testing be- 
gan. During these periods the patient 
was oriented as to the purposes and 
values of the testing program and at the 
same time provided with the opportunity 
for establishment of a good patient-ex- 
aminer relationship. However, as it was 
very often necessary, particularly in cases 
of “closed” head injury, for the neurolo- 
gist to get the psychologist’s opinion at 
once as to whether brain injury existed 
and some idea of the degree of impair- 
ment the pre-testing interview situation 
was not always a satisfactory procedure. 
It became apparent that some short, easy 
to administer, screening measure was 
necessary and valuable in these cases. 
The second point to be discussed is 
that of “limited sub-test variety”. We 
do not intend to convey the impression 
that the types of mental functions being 
sampled are limited but that the “all 
verbal’”’ aspect of the first half of the 
measure becomes monotonous. The 
writer has experienced numerous in- 
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stances during which criticisms have been 
voiced and the patient has become rest- 
less, irritable, suspicious, or depressed. 
The solution is to present the sub-test in a 
different order. Although the sub-tests 
have been standardized individually and 
not on the basis of a certain sub-test 
sequence, the effect of a random order 
presentation on the reliability and va- 
lidity of the measure is an open question. 

Closely allied to the above point is 
‘ the brain injured patient’s extreme sen- 
sitivity to failure. Most of these patients 
have a preconceived notion as to the 
consequence of brain damage. Some be- 
lieve that their injuries have reduced 
them to a state of moroncy, others, that 
insanity is sure to follow. These fears 
and the resulting anxiety have to be 
treated as neurotic manifestations. To 
the brain injured patients, all of the 
verbal sub-tests seem to be similar and 
continued inability to answer some of the 


items in each sub-test acts to summate 


their fears concerning their mental status. 
It is possible then to destroy rapport 
completely, making subsequent therapy 
difficult, creating an aversion to further 
testing, and instilling a sense of inade- 
quacy which may extend into depression 
or the adoption of the “I am a complete 
and permanent invalid” attitude. It takes 
all the skill that an examiner can muster 
to prevent this from occurring. 

A few of the patients were of the opin- 
ion that certain of the sub-tests were 
“kid stuff’. This attitude is obviously 
not conducive to good rapport or to ac- 
tive cooperation and full effort. Generally 
the Block Design, Object Assembly, and 
Picture Arrangement sub-tests were the 
ones which aroused these feelings. The 
material used in the first and the types 
of objects assembled in the second appear 
to be the reasons for the dislike. As for 
the third, the difficulty arising from their 
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inability to grasp the appropriate rela- 
tionship was expressed by calling it “a 
game for kids”. Although the presence 
of such an attitude is informative since 
it may be an expression of personality 
dysfunction, it makes scatter interpreta- 
tion difficult. In this respect anxiety and 
other neurotic trends are ever present 
problems. However, it is felt that such 
items tend to exaggerate or distort the 
findings and certainly lead to increased 
difficulty in differential diagnosis. 

It has been the experience of the 
writers that for all the brain injured cases 
the extent of co-operation and effort 
varied from sub-test to sub-test. This was 
true of the controls as well, but was not 
as marked. Retarded mental efficiency, 
in conjunction with all of the factors 
previously mentioned, prevents adequate 
control of interest and effort. This mo- 
tivational variance appeared to result 
chiefly from any or all of the following 
causes: (1) An expression of either a 
definite personality change or an exag- 
geration of certain aspects of the pre- 
injury personality. (2) An involuntary 
attention lag. (3) An attitude of doubt 
or fear occurring when the previous sub- 
test had been exceptionally difficult, and 
a number of obvious errors had been 
made. These factors which increase mo- 
tivational variance increase the difficulty 
of scatter interpretation. 

Inasmuch as each sub-test of the MAS 
has been standardized separately, the 
question of why a shortened form of this 
test was not used may arise. A short form, 
consisting of Vocabulary, Analogies-Simi- 
larities, Digit Symbol, and Block Design 
was tried, but was found to have several 
disadvantages: (1) the sub-test selection 
to comprise the short form was based 
on the assumption that. organic brain 
disease and post-traumatic brain injury 
would be reflected in an identical man- 
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ner by the patients’ performance on these 
sub-tests. This assumption was necessary 
because of the limited data available on 
post-traumatic cases, Our clinical experi- 
ence with the short form indicated that 
it did not satisfactorily differentiate be- 
tween brain injured patients and other 
types. This finding suggested that on 
the short form the performance of pa- 
tients with brain injury and organic brain 
diseases are not directly comparable. For 
this reason, a complete MAS was admin- 
istered to each patient. (2) As pointed out 
previously an estimate of a brain injured 
patient’s level of performance is of im- 
portance. It gives a base line for the de- 
termination of subsequent improvement 
and, through the varied sub-tests, specific 
deficiencies are indicated which provide 
a sound basis for re-education. The MAS 
and Wechsler-Bellevue, being closely 
comparable, are excellent measures for 
the test-retest technique. However, if 
part of the MAS is given as a short form 
and the entire test repeated at a later 
date, the effect of practice on the tests 
previously used cannot be adequately 
determined. It is obviously impossible, 
after giving the short form to merely add 
the remainder of the sub-tests later. 
There is definite evidence that improve- 
ment does occur so that a test given in 
two sections at different dates would very 
likely not tap the same level of general 
ability. (3) It was found that Analogies- 
Similarities did not quantitatively or 
qualitatively differentiate the two groups. 
An r,, between Vocabulary and Similari- 
ties was found to be .72 for both the 
brain injured and the controls. Inasmuch 
as the site of injury occasionally extended 
into the motor area, some patients could 
not take the Digit Symbol test. This 
meant that in some cases the diagnostic 
value of the short form was dependent 
upon the Block Design test, and as is 


indicated in Table 4, the validity of this 
test alone is not too high. 

We have already discussed the presence 
of neurotic or psychotic trends in the 
brain injured patient and have indicated 
the difficulty that these create in scatter 
interpretation. If the sub-tests of the 
Wechsler-Bellevue which are affected by 
neuroses, psychoses, and brain disease 


TABLE 4 
MAS sub-test validities 








Test 





Vocabulary 
Information 
Arithmetic 
Comprehension 
Similarities 

Digit Span 

Picture Completion 
Picture Arrangement 
Digit Symbol 
Object Assembly 
Block Design 





are compared, it will become apparent 
that at best differential diagnosis is a difh- 
cult task. It is admitted that the MAS 
and W-B are not identical but they are 
similar in content and we have findings 
to indicate that they yield similar results. 
If there are certain sub-tests which can 
be used to distinguish between brain in- 
jury, neurosis, and psychosis (and it is 
assumed that there are), the clinician 
faced with a brain damaged patient with 
neurotic or psychotic tendencies finds a 
differential scatter analysis extremely 
complicated and almost impossible. 
Returning to Table 1, it is evident that 
the sub-test results could have been in- 
terpreted as indicating the existence of 
either brain injury or schizophrenia. 
Added was the presence of a large num- 
ber of irrelevant comments, confabula- 
tions, and bizarre responses such as “a 
radio and a newspaper are alike because 
they can’t be seen, can’t see radio waves 
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or thin paper.” The Rorschach was 
strongly suggestive of schizophrenia, in- 
cluding position responses, color nam- 
ing, bizarre responses, contamination, 
and confabulation. However, the patient 
had sustained severe brain damage. Most 
of the brain injured patients gave indi- 
cations of at least mild neurotic disorders 
and occasionally a subject’s adjustment 
showed peculiarities resembling psychotic 
tendencies. Two patients included among 
the brain injured cases showed definite 
psychotic pictures, each several months 
after injury. 

It has been our experience that the 
MAS draws too heavily on “old” learning 
to be an excellent differential measure. 
The ability to form new relationships 
and the application of the brain injured 
patients’ present level of ability or effi- 
ciency to new situations in the important 
aspect to be considered. All too ‘often 
the extent of previous training and the 
type of cultural background has pre- 
vented adequate analysis of the sub-test 
results. Rapaport (23) makes the follow- 
ing observation, “it will be shown, how- 
ever, that certain deficiencies due to edu- 
cational environment or assets due to 
cultural predilection, may cloud or exag- 
gerate some of these diagnostically dis- 
tinguishing features of impairment’. 

Every clinician is aware that before 
any psychological test is to be given it is 
mandatory that as much be known about 
the patient and his background as 
possible. However, if there are certain 
educational and cultural variables pres- 
ent that will influence the performance 
on certain sub-tests, the question of how 
they can be allowed for and equated 
arises, even if the examiner is aware of 
them. Frequently a moderately brain in- 
jured and occasionally a severely dam- 
aged patient’s performance on the MAS 
was such that it was impossible to detect 


the presence of any intellectual impair- 
ment. These cases referred to had mini- 
mal sub-test scatter and scores in the 
average range. To all appearances they 
were completely normal records. How- 
ever, after a few minutes conversation 
and casual observation it became very 
evident that they had suffered an intel- 
lectual loss. The Rorschach showed this 
very clearly, many of the “signs” of post- 
traumatic cerebral injury being present 
(2). Their intellectual control was poor 
and their ability was not being utilized 
at the level that might be expected from 
the total MAS score. In other words, the 
MAS does not necessarily yield evidence 
as to how efficiently the indicated ability 
is being employed. 

The final point to be discussed is the 
question of validity. Any psychological 
test, whether it be designed to sample 
intellect or personality, has a definite 
problem in the establishment of a cri- 
terion against which the measure can 
be validated. If the MAS is to be con- 
sidered as a test of adult intellect alone 
it is probably as valid as any test for 
this purpose, but if it is to be considered 
as a differential measure to be used for 
the diagnosis of certain personality dys- 
functions and the presence of organic 
brain disease or damage, we are faced 
with an entirely different problem. It 
would seem that brain damage should 
be the perfect dichotomous variable, as 
the pneumo-encephalogram, neurological 
findings, surgical reports, and the EEG 
should establish the existence of brain 
injury without question. Unfortunately 
all is not as simple as it appears. For ex- 
ample, can it be assumed that frontal, 
parietal, occipital or temporal injuries 
will all have the same behavioral resid- 
uals? Was the damage focal, diffuse, or 
penetrating? How much tissue was lost 
and how will it affect performance? These 
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neurological aspects alone, some of which 
cannot be adequately ascertained while 
the patient lives, are enough to indicate 
the difficulty involved in determining the 
criterion of brain injury. However, if 
the presence of tissue damage alone is 
considered adequate, there is still the 
problem of comparing the results of those 
obtained from various types of person- 
ality dysfunction, With this as a frame 
of reference and considering the existence 
of post-traumatic brain injury to be an 
acceptable criterion, what is the validity 
of each sub-test of the MAS? 

The cases used were to some extent 
selected. There were 50 controls and 71 
brain injured cases of the same average 
age. The former were without brain 
damage, considered well adjusted, and 
were within the normal range of intelli- 
gence. The latter group was distributed 
as follows: Eight cases had severe, 40 
moderate, and 23 mild traumatic brain 
injuries. The pre-injury intelligence of 
the brain injured group was estimated 
on the basis of the “hold” tests and all 
available Rorschach data. Although this 
method is open to question all patients 
were considered to have been within the 
normal range. It is obvious that individ- 
ually the sub-tests could never be de- 
pended upon to adequately determine 
the presence of brain damage. Actually 
these validities indicate that if given two 
groups, one with and one without brain 
injury, a diagnosis based on chance selec- 
tion would give comparable results. 
These findings, of course, do not give any 
direct information as to what the validi- 
ties would be if the sub-tests were used to 
differentiate brain injury from neuroses 
or psychoses, but the inference is that 
they would be even lower. 

The value of the measure is not com- 
pletely dependent on the use of the single 
sub-tests, nor from the scatter pattern 


that they may form. To those who believe 
that the diagnostic value of the MAS 
consists in comparing a scatter pattern 
to one already established and by means 
of such a comparison labeling a disorder, 
it is suggested that approximately as valid 
results can be obtained by guessing. It is 
not intended to convey the impression 
that the MAS is a valueless instrument. 
On the contrary, it has been found to be 
one of the most useful. It has been em- 
ployed with benefit not only for the 
determination of the IQ and special dis- 
abilities, but for diagnosis as_ well. 
Rapaport (24) has estimated that the 
Wechsler-Belleyue will be definitely diag- 
nostic in 30-40% of the cases and indi- 
cative in 30-40% more. We have found 
the MAS differentially diagnostic in 40% 
of all types of cases and to show definite 
trends in an additional 30%, but only 
if the total behavior was considered. If 
the scatter pattern alone was used it was 
found that we could be sure in only 18% 
of the records and get some indication in 
but 20% more. 

The MAS and the Wechsler-Bellevue 
have a distinct advantage in that they 
not only require a subject to say some- 
thing but to do something as well. Ob- 
servance of how the patient reacts to a 
situation, his mode of approach, how he 
organizes his thought, and the interest he 
shows, are all of the utmost importance. 
Through the ypse of Rapaport’s technique 
of “testing the limits” the scope of both 
the MAS and W-B can be extensively 
increased. Only by adding together all 
the qualitative and quantitative data do 
these instruments function efficiently. 
However, the obvious corollary, a test is 
only as good as the person using it, still 
holds true. A high percentage of success- 
ful diagnosis depends upon “examiner 
validity”, that is, on the background and 
experience of the clinician, not only with 
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the test itself but with all types of mental 
variants. Sometimes conclusions regard- 
ing a patient’s clinical status becomes a 
fusion of test performance and _ behav- 
ioral impressions perhaps not even con- 
nected with the actual test administra- 
tion. This leads to the dangerous practice 
of stretching the tests’ limitations and 
creates the impression that the instru- 
ment will produce clinical data beyond 
its capability, Both the MAS and the 
W-B are fully structured and as a result 
the type and variety of performance is 
limited. They have a definite place in a 
battery of tests but are not to be con- 
ceived of as perfect single measures. 
Some of the points discussed may ap- 
pear to be the effects of an artificial war- 
created situation. However, a_ large 


portion of the cases included in this 
study received brain damage after the 
war period and further, those patients 


who were injured during combat or un- 
der combat conditions were well aware, 
upon hospitalization, that their tour of 
active duty was over. In any hospital, 
army or civilian, the patient is always 
concerned with his chances of regaining 
his prior state of mental or physical 
health; whether or not he is improving, 
and how long it will be before he is re- 
leased from the hospital. All of these 
have been the primary concern of nearly 
every individual considered in this study. 


B. THE SHIPLEY-HARTFORD RETREAT 
SCALE FOR INTELLECTUAL 
IMPAIRMENT 


In a previous study (1) the Shipley was 
found to be of little aid in establishing 
the presence of brain injury. Certainly 
one of the most outstanding reasons for 
its failure to be of value lies in, its struc- 
ture. “The CQ [Conceptual Quotient] 
scale is based upon the clinico-experi- 
mental observation that in mild degrees 
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of mental deterioration, and in other 
conditions involving mental impairment, 
vocabulary is relatively unaffected, but 
the capacity for Abstract (conceptual) 
thinking declines rapidly” (30). Obvi- 
ously if a decline in concept formation 
occurs in all types of psychotics, even to 
a limited degree, differentiation between 
such disease entities and traumatic dam- 
age is going to be nearly impossible. 
Added is the fact that there is evidence 
(1) that neuroses as well as psychoses af- 
fect the CQ. We are not questioning 
the statement that the test indicates the 
presence of impairment. In a previous 
study (1) it was found that it does. How- 
ever, one can never be sure of the cause. 
When the conceptional quotient (CQ) 
is low, all that can be safely said is that 
impairment of some type is present. 

As has been stressed, it is important 
in brain injury to determine specific 
losses in intellectual functioning. The 
Shipley can offer very little in this re- 
spect. The MAS, W-B and Rorschach, 
on the other hand, not only give certain 
insights in this respect but tap other 
functions and aspects as well. It is not 
enough to indicate the existence of im- 
pairment, as it leaves the questions of 
the type, degree, and reason for the loss 
unanswered. It should be noted that only. 
the extremes of the categories listed in 
the Shipley manual are presented here; 
therefore, the percentages of any group, 
e.g., “severe”, will not add up to 100 
per cent. 

In comparing two groups, one with 
and one without brain injury, it was 
found (1) that the validity of the scale, in 
this restricted sense, was only .25. The 
low validity coefficient at first was be- 
lieved to be partially caused by the in- 
clusion of a number of neurotics in the 
control or non-brain injured group. 
These cases were omitted and the biserial 





TESTS USED FOR THE EVALUATION OF BRAIN INJURY 15 


validity coefficient recomputed. The new 
coefficient was found to be .g0. This find- 
ing makes it apparent that the presence 
of personality variants was not alone re- 
sponsible for the low validity. The CQ’s 
of the brain injured patients were then 
re-plotted and the results are shown in 
Table 5. Forty-four per cent of the total 
brain injured group obtained scores in 


cases tend to earn low quotients. For this 
reason extreme caution must be observed 
in interpreting quotients from individ- 
uals with vocabulary scores below 23 (14 
yrs.) (30)”. In addition to the possible 
invalidity of scores for persons of low 
intelligence, an occasional brain injured 
patient’s vocabulary score has been lower 
than should be expected from the ob- 


TABLE 5 


Percentage of brain injured patients falling into certain 
of Shipley’s impairment ranges 








Severe 


Moderate Mild 





CcQ’s N % 


N N % % 





Normal I 13 
Slightly Suspicious 3 38 
Probably Pathological I 13 





or slightly below the normal range and 
only 17% received scores that were con- 
sidered “‘probably pathological”. With- 
out considering the results of the control 
group, the reason for the low validity 
becomes: apparent. A number of the 
brain injured cases did not suffer any 
demonstrable loss in the abilities re- 
quired by this test. It is evident that a 
one aspect measure will not establish the 
presence of organic brain damage in 
every case. It is also interesting to note 
that some of the brain injured patients, 
especially in the mild category, did not 
give an “organic” record on either the 
MAS or the Rorschach but did exhibit 
definite neurotic trends. The low CQ’s 
in these cases may well be due to person- 
ality disturbances. If this is true, the 
validity of the scale, in a differential 
sense, is probably even lower. 

The Shipley is also limited in that, 
“the available evidence indicates that 
CQ’s obtained from sub-normals are not 
valid. Feeblemindedness and borderline 


15 32 33 
3 6 II 


10 21 17 





tained IQ or MA on a Wechsler-Bellevue 
or MAS. Such instances have been rare 
in our experience but have occurred. 
This indicated a source of additional 
cases for whom the Shipley cannot be 
used, inasmuch as each of these CQ’s has 
had to be considered invalid. 

Any self-administering test has certain 
advantages and disadvantages that are 
evident to every clinician. However, cer- 
tain of the disadvantages become more 
apparent when dealing with the brain 
injured patient. An impersonal relation- 
ship does little to establish confidence 
and trust in the psychologist. If the Ship- 
ley is used as a screening device, regard- 
less of how the test situatian is handled, 
little actual patient-examiner relation- 
ship is gained. Thus little opportunity 
is provided for the establishment of rap- 
port which would be valuable in further 
testing. Of course this disadvantage can 
be offset by holding a few interviews or 
giving other tests before the Shipley is 
used, but, as has already been indicated, 
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its use as a screening device is the only 
possible way in which it can profitably 
be employed. 

We have noticed, as has Shipley (30), 
that some patients fail to comprehend 
the directions, but more important are 
those instances in which the subject does 
not care to admit his lack of under- 
standing or has little interest and moti- 
vation. Each of these situations can often 
be remedied by good rapport. 

Finally the Shipley is so structured that 
little if any behavior is exhibited that 
has clinical significance. The test does 
have certain advantages: (1) It is very 
short, (2) it can be administered in 
groups, 2d (3) if the interest is to deter- 
mine the presence or absence of intel- 
lectual impairment, regardless of its 
cause, the test is of value. 


C. THE HUNT-MINNESOTA TEST FOR 
ORGANIC BRAIN DAMAGE 


In general the Hunt-Minnesota test 
for Organic Brain Damage may be criti- 
cised on the same basis as the Shipley- 
Hartford Retreat Scale. The test is one 
of limited aspect. It is true that there are 
a number of interpolated tests but the 
scoring standards for these are so gener- 
ous that they are of little or no value. 
It is our opinion that these iests may 
have more diagnostic value than the T 
score if the scoring were revised. 

The ever present problem of validity 
must also be considered. The results ob- 
tained in a previous study (1) indicate 
clearly that, as far as post-traumatic brain 
injury is concerned, the test cannot be 
relied upon to adequately detect the 
presence of brain injury. It is interesting 
to note that the r,, obtained between 
the Shipley and the Hunt was only .263 
which was not significant at the 5% level 
of confidence. Certainly it is to be ex- 
pected that two tests, both supposedly 
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measuring impairment, will have a cor- 
relation coefficient that is at least signifi- 
cantly greater than zero. In addition 
there is nothing in the manual or in 
Hunt’s article describing the test (13, 14) 
to indicate that the T score may not be 
raised by neurotic difficulties in patients. 

The use of interpolated tests or ma- 
terial is questionable procedure, inas- 
much as the possible presence of inhibi- 
tion or confusion is a variable that has 
not been checked experimentally. Some 
definite results should be presented on 
this point before this technique is to be 
considered an acceptable testing method. 

In general, we have not found the test 
to be stimulating to the brain injured 
patient. This factor made it difficult in a 
number of cases to maintain motivation 
and prevent unconscious or conscious 
malingering. 

As with the Shipley, the structure of 
the test prevents the manifestation of 
much diagnostically valuable overt be- 
havior. This largely deprives the tester 
of the opportunity of observing methods 
of approach and the mechanics of prob- 
lem solving which are so apparent in 
the Wechsler-Bellevue or the MAS. 

Our experience and evaluation of the 
Hunt indicates that it contributes little 
to the understanding of the brain injured 
patient, whether used individually or as 
a part of a battery (1). 


D. THE RORSCHACH TEST 


In a previous study (2) we have, pro- 
posed, described and evaluated various 
specific signs which may be indications 
of organic cerebral alteration. The Ror- 
schach records and behavioral signs 
given during the test administration were 
compared in an experimental group of 
6o brain injured patients and a control 
group of 100 hospital patients without 
brain injury. The ten signs of organic 
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brain injury that Piotrowski has previ- 
ously postulated (22) were investigated, 
and five of them were found to be of 
value in differentiating between post- 
traumatic brain injured and control pa- 
tients. In addition, nine new signs were 
studied, and their value indicated. We 
would now like to consider the signs 
found to be helpful, not in connection 
with the comparative frequency of their 
occurrence in brain injured and control 
groups, but in respect to the reasons why 
these signs occur more frequently among 
patients with organic cerebral alteration 
than among controls. 

Of the ten signs previously pointed out 
by Piotrowski (22), Impotence, Perplex- 
ity; Automatic Phrases, Repetition and 
Color Naming were found to be of value 
in differentiating between the post-trau- 
matic brain injured patients and the con- 
trols (2). A considerably higher number 
of neurotics were included in tue control 
group than would have been obtained 
through testing a general run of hospital- 
ized patients, inasmuch as many were 
referred for examination because of 
suspected neurotic disturbances. The 
ideal situation would have been to com- 
pare the Rorschach records of the post- 
traumatic group with normals and with 
clear cut groups from each of the neu- 
rotic and psychotic classifications, in or- 
der to establish definitely the value of 
proposed findings in differential diag- 
nosis. This, however, was impossible in 
the situation in which the study was 
done. Some practical value may be 
present in the approach that was made 
inasmuch as the results indicate that 
Rorschach findings frequently differenti- 
ate post-traumatic brain injured patients 
from patients hospitalized primarily for 
other physical disorders. 

Nine other signs, named, described 
and evaluated in the study referred to 


(2), are also of definite assistance in deter- 
mining the presence of cerebral deficit. 
Although it is of some value to obtain 
indications of the presence or absence of 
cerebral deficit, in traumatic cases this 
question is often answered by surgeon’s 
reports, pneumoencephalography, or 
other neurological findings. We believe 
that the principal aim of psychological 
testing in these cases should be to evalu- 
ate possible intellectual impairment and 
information regarding the psychic ad- 
justment of the individual to the trauma. 
Therefore we ask the questions, why do 
these signs occur more frequently in post- 
traumatic brain injured than in control 
patients? What are the dynamic person- 
ality mechanisms, either intellectual or 
affective, that cause these signs to be pre- 
sented? 

Although we have noticed certain per- 
sonality factors that may account for the 
presence of some of the signs of post- 
traumatic cerebral deficit, factors not 
noticed by us may also play a definite 
part. The interplay of both intellectual 
and affective disturbances is probably 
present as a cause of the manifestations 
of most of the signs. In our opinion some 
of the signs are shown as emotional re- 
actions to the recognition of impairment 
in intellectual functioning. Other signs ~ 
probably represent characteristic tech- 
niques or behavioral patterns adopted 
by brain injured patients to overcome the 
frustration arising from performance 
they judge to be unsatisfactory. Still other 
signs seem to be primarily intellectual 
in nature. It has been found that the 
intellectual level of the patient will af- 
fect the signs of cerebral injury given 
(3). We have been unable to incorporate 
indications of personality maladjustment 
such as anxiety, hysteria, depressive tend- 
encies, or hypochondriasis into the diag- 
nostic pattern of brain injury, inasmuch 
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as we have been unable to determine 
characteristic differences in these Ror- 
schach indications given by brain injured 
patients and neurotics without brain in- 
jury. 
¥ Impotence is defined by Piotrowski as 
the patient’s recognition of the inade- 
quacy of a response with the inability to 
either withdraw or improve it. This sign 
is probably related to the intellectual 
impairment often present following trau- 
matic brain injury and also to the adjust- 
ment of the individual following injury. 
Specifically, this seems to be a manifesta- 
tion of the deep feeling of uncertainty 
and lack of personal confidence which 
we have seen in many of these cases. The 
headaches, confusion, dizziness, retarda- 
tion of thought, and other organically 
determined symptoms usually following 
severe head trauma probably contribute 
to the patient’s lack of personal confi- 
dence. The patient feels that he must give 
some responses, but he is not sure 
whether he is behaving properly. He does 
not know if his post-injury behavior is 
revealing peculiarities unknown to him- 
self. Therefore he gives responses, doubts 
their adequacy, but is unable to with- 
draw or improve them because he does 
not know what to give in their place. 
._Perplexity, or the subject’s distrust of 
his own ability and a request for assur- 
ance, seems to be very similar to Im- 
potence in regard to the reason for its 
manifestation. It, too, probably springs 
from a lack of personal confidence which 
may well have been accentuated by the 
subject’s recognition of temporary or 
permanent impairment in intellectual 
functioning. As previously mentioned, 
the “psychic value” of the head has been 
noted in many cases as an additional 
factor in the development of personal 
uncertainty. 
‘’ Automatic phrases, or the use of a 


stereotyped phrase in an indiscriminate 
fashion in more than half of the cards, 
and Repetition, or the occurrence of 
similar responses at least three times in 
a record without regard for form, prob- 
ably represent intellectual peculiarities 
frequently found in brain injured per- 
sons. Possibly these types of behavior 
arise because they represent easy ways to 
complete the test—a tendency to follow 
the path of least resistance. Observations 
and questioning indicate that these signs 
are given without the patient’s awareness. 
They do not intentionally resort to these 
methods in order to make the task easier. 

At least one occurrence of Color Nam- 
ing has been considered a particularly 
important sign in cases with organic in- 
tracranial pathology (16), but in our 
study of post-traumatic brain injured 
cases, it was somewhat less important. 
Kelley considers color naming an indica- 
tion of “. . . the confusion of the patients 
in relation to the environment and rep- 
resents the emotional lability and insta- 
bility which occurs so often”. 

Consideration of the Ink-blots as Rep- 
resentations of Actual Objects, Concrete 
Responses, and Inflexibility or the in- 
ability ta use any part of any of the ten 
figures for more than on association, are 
signs which are closely allied with the 
type of impairment discussed by Gold- 
stein when he considers the inability of 
brain injured to assume the abstract at- 
titude (9). 

Consideration of the Blots as Actual 
Objects springs from the brain mjured 
patients’ dependence for association upon 
concrete stimuli. An extreme form of this 
type of behavior is extensively described 
and discussed by Hanfmann, Ovsiankia, 
and Goldstein (12). This patient often 
spoke to persons in pictures, failing to 
recognize that they were not actual 
people. The sign Concrete Responses, 
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scored when a record gave no indication 
of association involving the quality or 
attributes of responses, is obviously re- 
lated to a lack of the assumption of the 
abstract attitude. We do not suggest that 
this sign necessarily represents an impair- 
ment in the ability to assume an abstract 
attitude, but it has been found much 
more frequently among brain injured 
patients than controls. Inflexibility has 
been noted by various writers, using a 
number of experimental procedures, as 
the brain injured patient's inability to 
shift. This behavior is also considered to 
be a manifestation of inability to assume 
the abstract attitude. Kelley (16) quotes 
Bolles and Goldstein to substantiate this 
position, “He (brain injured patient) is 
unable to shift from one type of attitude 
to another voluntarily”. This voluntary 
shifting according to Goldstein, presup- 
poses the capacity for the abstract atti- 
tude or categorical behavior. Weig] also 
studied this phenomenon and _ verified 
the findings of Goldstein, believing that 
the normal could classify on various 
bases, whereas the brain injured patient 
once having adopted a specific classifica- 
tion could not shift to another. Kelley 
concludes, “this inability of the patient 
to shift his concepts even though an obvi- 
ously good form is offered (suggested by 
the examiner) seems to be definite indica- 
tion of the impairment of abstract 
behavior. If present it points almost 
pathognomonically to organic intra- 
cranial damage or to a schizophrenic pioc- 
ess”, It must be noted that Kelley elicits 
this sign by suggesting alternative re- 
sponses to the patient during the “testing 
the limits” period. It may be inferred 
from the previously given definition of 
our sign, Inflexibility, that it is deter- 
mined by sciutiny of the responses given 
vane the test period. 

Unclear definitions of responses had 


/ 
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been found to be one of the most helpful 
signs in differentiating between post- 
traumatic brain injured and control pa- 
tients (2). It is probably primarily a mani- 
festation of the intellectual impairment 
suffered by many patients with organic 
cerebral deficit. Its principal difficulty 
in practical use is that judgment of its 
presence is largely based on subjective 
consideration, and thus its value relies 
heavily upon the experience of the ex- 
aminer. 

The personality mechanisms giving 
rise to the sign Edging are in doubt. Beck 
states that in his experience edging is 
exclusive schizophrenic behavior, but we 
have noted it in 41.6 per cent of a group 
of 60 brain injured patients and in 17 
per cent of a group of 100 control pa- 
tients including neurotics (6). Beck ex- 
plains the sign among schizophrenics by 
saying that it “, . . is simply another 
peculiarity with which these patients re- 
act to stimuli and handle their problems. 
How much it projects a captious caution, 
alien to normal procedure, and how 
much it is odd posturing, I am not ready 
to say” (6). 

Irrelevant comments, or the expression 
of a statement during the testing situ- 
ation which is not in any noticeable way 
pertinent to the test, has been cbserved 
in patients with brain injury. This sign 
may be factors basic to this districtibil- 
ity of the brain damaged patient, which 
has been discussed by Goldstein (8). Im- 
pairment in attention and concentration 
may be factors basic to this distractabil- 
ity. In addition, it is entirely possible 
that this behavior may be partially 
caused by the patient’s desire to escape 
the testing situation at least temporarily; 
a situation which accentuates the lack of 
self-confidence which has been seen in a 
large percentage of brain injured pa- 
tients. 
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Covers Parts of Cards and Withdrawal 
and Re-attack are signs that also have 
been noted. The first occurs when the 
patient excludes part of the ink-blot 
from his vision with his hands. The 
second is present when a subject volun- 
tarily removes his attention from a card, 
perhaps turning the card over or looking 
in another direction, and suddenly re- 
news his scrutiny. We believe that these 
signs are behavioral patterns which 
spring from a recognition of inadequate 
performance and thus permit the patient 
to escape a more distinct recognition of 
inadequacy with more intense feelings 
of frustration. Other factors are probably 
also involved. Covering parts of the cards 
may be an attempt to combat distracti- 
bility by excluding stimuli other than 
those selected for immediate scrutiny and 
concentration. Withdrawal and Re-at- 
tack may be partially an attempt to get 
a new view of the situation, a different 
mental set. In this respect it is related to 
the “inability to shift” seen in certain of 
the sub-tests of the screening device pre- 
sented later in the paper. 

Catastrophic Reaction is a sign which 
/ probably represents the failure of many 
of the signs, previously discussed, in 
meeting the patient’s attempt to escape 
frustration. Many of the other signs were 
explained, at least in part, as mechan- 
isms used to satisfy the deep feeling of 
personal inadequacy, accentuated by 
recognized intellectual impairment, in 
many brain injured persons. Our obser- 
vation has indicated that these other 
signs are first shown by the patient and 
when a catastrophic reaction occurs, it is 
a culmination of growing feelings of frus- 
tration which could not be averted by 
expression of the other signs. The fact 
that Catastrophic Reaction was found 
in 31.7 per cent of the brain injured and 
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only 1 per cent of the controls, and fur- 
ther that 73 per cent of the severely in- 
jured showed this sign, substantiates this 
theory. It is to be expected that fewer 
brain injured patients would manifest 
catastrophic reactions than the other re- 
lated signs. The other types of behavior 
are used first, but when the test pro- 
gresses and these are not satisfactory, it 
is necessary to make a frank admission 
of frustration by engaging in a catastro- 
phic reaction. It should. be mentioned 
that Goldstein (8)-has described and dis- 
cussed these reactions arising among 
brain injured persons in other situations. 

We must emphasize that the Rorschach 
signs shown by the post-traumatic are not 
necessarily restricted to this group. A 
previous study has shown that they occur 
much more frequently among the brain 
injured than in a control group of hos- 
pitalized patients, including many neu- 
rotics but no one with central nervous 
system disorder (2). However, it is quite 
possible that psychic dynamisms in many 
persons could cause the manifestation of 
at least some of these signs. The actual 
value of these signsin differential diag- 
nosis can be determined only when con- 
trolled studies have been made compar- 
ing post-traumatic brain injured cases 
with selected groups of persons with 
various psychotic and neurotic disorders. 

In our previous study it was possible 
to detect. indications of typical “organic 
brain injury” manifestations by use of 
the Rorschach in a high percentage of 
the patients with post-traumatic cerebral 
injury. In the experimental group 70 per 
cent were considered as “definitely brain 
injured” and 14 per cent were evaluated 
as showing “significant indications of 
brain injury”. Although: most of the re- 
maining 16 per cent gave at least one of 
the signs we have found to be typical, 
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the signs were not present in sufficient 
quantity or degrees of intensity to justify 
consideration as significant. 

It will be of interest to consider the 
basis on which the classifications of “‘defi- 
nite brain injury” and “significant indi- 
cation of brain injury” were assigned. In 
our opinion, a’ procedure of merely 
counting the number of signs present (3) 
will not give satisfactory results. Un- 
doubtedly some cases wou'd be correctly 
classified if this method were followed, 
but further considerations are necessary 
for more accurate work. We have found_ 
three points to be most important: (1) / 
The intelligence level of the subject; (2), 
the number of signs present; and (3) | 
the intensity of these signs. The intelli-~ 


gence level is important because the | 


number of signs present has been found / 
to decrease as the intelligence level in¥ 
creases (3). The absolute number of signs 
given must, of course, be considered in 
regard to their experimentally deter- 
mined significance in differentiating be- 
tween brain injured and control patients 
(2). The intensity with which the signs 
are given can best be evaluated only after 
considerable experience with these pa- 
tients. This point should not be disre- 
garded (although the weight placed on 
these judgments must be determined by 
the experience of the tester), because it 
has been foand to be of definite clinical 
value. Some brain injured patients give 
relatively few signs, but the great in- 
tensity often justifies assumption of the 
presence of brain damage. 

It is also sometimes of verifying value 
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to consider the results of other tests and 
the past history of the patient in attempt- 
ing to determine if the level of perform- 
ance indicated by the Rorschach roughly 
agrees. It is, of course, hazardous to base 
conclusions on this comparison alone. 
Certain neurotic tendencies, viz., anxiety, 
hypochondriasis, and depression, are fre- 
quently indicated by the Rorschach in 
cases of brain injury. However, we have 
found no way in which these indications 
in themselves differ from those given by 
neurotics without brain injury. 

A brief evaluation of the Rorschach 
will be made in comparison to the 
Wechsler-Bellevue, MAS, Shipley and the 
Hunt. Our studies have indicated that 
the presence of organic cerebral altera- 
tion is more frequently indicated by the 
Rorschach than by the other tests men- 
tioned. Obviously this is due to its ability 
to tap areas of possible impairment be- 
yond the scope of the other tests. It has 
certain disadvantages such as its length 
and its appearance. Even in the hand of 
a skilled examiner, the test tends to 
arouse suspicion, which in all probability 
arises from its unstructured nature. Per- 
haps the greatest drawback to its use lies 
in the degree of interpretative skill neces- 
sary which comes oniy with extensive 
experience and training. The test is also 
open to the same fault as the MAS or 
W-B in that the limits of the test can be 
exceeded. To be sure it is the best single 
measure that we have used for the pur- 
pose of detecting brain injury; however, 
it functions most efficiently when it is 
used as a part of a battery. 





IV. REQUIREMENTS FOR A SCREENING TEST 


ROM the discussion of the MAS, 

Shipley, Hunt and the Rorschach it 
is apparent that a screening device would 
be a valuable addition to a battery of 
tests to be used with brain damaged pa- 
tients. It would eliminate the frequent 
problem of the need for quick diagnostic 
aid and at the same time provide land- 
marks for further testing. To do this 
efficiently certain prerequisites must be 
met. The following, although not all in- 
clusive, are certainly basic. 

1. The measure must be short.—This 
prevents fatigue and assures good rapport 
as short interviews can be held both be- 
fore and after the test without prolonging 
the initial meeting. 

2. Interesting.—It is essential to deter- 
mine the presence or absence of mental 
impairment. If this evaluation is to be 
reliable and valid, the tests must catch 


and hold the interest of every patient. 
3. Easy.—It is understood that a per- 
fect measure would be one on which 


neither a zero nor a perfect score could 
be obtained, This is difficult to attain as 
included in the frame of reference must 
be the consideration that every brain in- 
jured case must experience success. In 
addition, this success must be apparent 
to him. The habit of saying, “good”, 
“fine”, or “you did well on that one”, 
does not suffice. In fact, constant repeti- 
tion of those phrases in the face of actual 
or suspected failure may induce suspicion 
and result in the patient’s loss of confi- 
dence in the examiner. The test as a 
whole has to be easy, as some brain in- 
jured patients experience a definite loss 
in mental efficiency. As a consequence, 
a test which is satisfactory for patients 
with definite intellectual loss, might not 
be adequate in cases of mild or only 
suspected injury. Conversely, test which 


operates efficiently for cases of suspected 
injury might be too difficult for persons 
with severe cerebral disturbances. This 
can be compensated for by using only 
sub-tests which are of exceptional inter- 
est, allowing added time, and skillfully 
giving a few hints in the event of initial 
failure. If this procedure is accomplished 
with care the patient will look upon the 
added help as part of the test and will 
consider the solution his own. 

4. Relatively unaffected by neurotic 
trends.—As has been pointed out, the 
diagnostic value of any measure is de- 
pendent upon its ability to present a 
clear cut differential picture. 

5. Sample those functions that seem to 
suffer most as a result of brain injury.— 
If there are certain abilities which are 
usually impaired by brain damage, and 
if these can be isolated, it would then be 
possible to construct an experimental 
differential measure. As indicated by 
Wechsler (32) and.in our previous study 
(1) it appears that certain intellectual 
functions have suffered more than others. 
These findings did not apply to every 
case of brain injury but were based on 
the mean scores of the total group. Using 
these results as guides, a test to be dis- 
cussed in detail later, has been assembled. 

6. Understandability—By this is 
meant the development of a feeling, on 
the part of the patient, that the test 
being given is appropriate. Most of the 
subjects form opinions, right or wrong, 
as to what the test is testing. If a possible 
reason for a particular item is not ap- 
parent they become suspicious as to its 
purpose and usually express these feel- 
ings in such statements as, “I don’t see 
how this will help me to get any better’’. 
It is neither feasible nor good technique 
to explain each test in advance. If the 
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items can appear appropriate, irrespec- . 


tive of their underlying purpose, it is a 
distinct advantage in establishing and 
maintaining rapport and also has a defi- 
nite therapeutic effect. The patient feels 
that the entire procedure is aimed at 
discovering aids to alleviate his particu- 
lar difficulty. 

». Have a minimum dependence on 
previously learned material.—This has 
already been discussed in detail. How- 
ever, a fundamental consideration is the 
ability of the patients to form new rela- 
tionships and to apply their present level 
of ability to new situations. 

8. Performance items should be in- 
cluded.—This insures an adequate sample 
of the patient’s total behavior. 

g. Validity.—The examiner should have 
data available which indicates the degree 
to which the test can be relied on to 
measure what it is intended to measure. 


10. The test should be reliable. 

11. Directions should be simple, clear 
and easily understood. 

12. All performance tests should be of 
such nature that they can be accom- 
plished by gross muscular movements.— 
We have encountered a number of in- 
stances when it became difficult to in- 
terpret scores from such tests as the Digit 
Symbol. To do well on this test fine pre- 
cise muscular movements are required 
and if the injury is diffuse it is possible 
that motor area involvement may have a 
definite effect on the performance. That 
is, an added variable has been intro- 
duced, the presence and degree of effect 
of which cannot be readily determined. 
In addition there are a number of in- 
stances where the ability to employ gross 
movements has remained unimpaired 
while more specific movements have been 
destroyed. 





V. Proposep SCREENING TEST 


A. METHODS AND PROCEDURE 


HE FINDINGS obtained from a com- 
gone of MAS results from a 
group of brain injured with a group of 
controls (1) can be divided roughly into 
two general classifications; those that ap- 
peared to be definite, and those that were 
suggestive. The former were considered 
to be losses in; (1) analysis and synthesis, 
(2) ability to shift, and (g) ability to learn. 
The latter category included losses in (1) 
ability to integrate two points of view 
or to perceive a double relationship, (2) 
ability to plan ahead, (3) ability to antici- 
pate, (4) ability to stick to a point. (This 
loss seemed to hinge upon the continuity 
and organization of the patient’s think- 
ing and approach), (5) definite persever- 
ative trends, and (6) possible memory 
defect. In order to (a) check these find- 
ings, (b) study the capabilities of the 
brain injured patient further, and (c) 
attempt to construct a workable valid 
screening device for the detection of 
brain injury, a five item test was as- 
sembled. Each of these sub-tests were 
considered from a dual standpoint. First, 
did they individually and collectively 
satisfy the previously discussed criteria 
for the adequate screening device? 
Second, did they test those intellectual 
functions which had been thought to be 
definitely vulnerable and even more im- 
portant, to sample those which were 
considered questionable? None of the 
items adopted are original. Three of 
them are parts of the Army Individual 
Test (4), which has not yet been released 
for civilian use. Each item will be dis- 
cussed in regard to structure and admin- 
istration (including scoring). 


B. CASE MATERIAL 


The brain injured group consisted of 
44 patients who were known to have 


24 


sustained cerebral damage. The evidence 
was derived largely from surgeons’ re- 
ports. In the instances where these were 
lacking, positive pneumo-encephalograms 
and/or neurological findings were avail- 
able. The source of these injuries ranged 
from high velocity missiles to auto acci- 
dents. In regard to the severity and type 
of injury the neurologist distributed the 


TABLE 6 


Post-injury intelligence level of the 
brain injured group 








Brain Injured 
Group 
N Per Cent 
6 


II 
24 
3 


Intelligence 
Quotients 





14 
25 
54 

7 


75- 79 
80-— 89 
go-109 
Over 1000 





44 cases as follows: 11 severe, 21 moder- 
ate, and 12 mild; g were considered to 
have focal lesions, 17 were classed as 
focal-diffuse and 18 were diffuse. The 
pre-injury intellect of these patients was 
determined by the previously described 
method; 18 per cent were dull normal, 
66 per cent average and 16 per cent above 
average. The present level of capability 
was determined by the use of the MAS. 
The distribution of the total scores or 
1Q’s is shown in Table 6. As had already 
been indicated the 1Q does not indicate 
the true intellectual status of these pa- 
tients and should be interpreted with cau- 
tion. 

The control group was composed of 
two sub-divisions, normal and neurotic. 
The former (N = 45) consisted of hos- 
pital attendants considered to be well 
adjusted, within the normal range of 
intelligence, and had neither received a 
head injury nor had record of any type 
of disease that might have resulted in 
intracranial pathology. The latter (N = 
16) was a group of patients with mild 
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affective states, all of whom had just 
started to undergo psychotherapy at the 
time of testing. None of them had a his- 


TABLE 7 
Site of the trauma 








Brain Injured 
Group 
Area 





N Cent 





Frontal (left or right) 
Frontal-temporal (left or right) 
Parietal (left or right) 

Parietal (vertex) 

Temporal (left or right) 
Temporal-parietal (left or right) 
Occipital (left or right) 
Occipital-temporal (left or righ t) 
Occipital-parietal (left or right) 
Left frontal-left parietal (pene- 
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tory of head injury and all were within 
the normal range of intelligence. The 
intelligence breakdown was as follows: 
15% were dull normal, 65% average, 
and 20% were above average. 

Because the samples are small, each 
group will be described’ as fully as 


possible to determine the existence of 
any outstanding differences that might 
account for the obtained quanitative and 
qualitative results to be discussed later. 
The composition of the brain injured 
group, from the standpoint of the site of 
the trauma is summarized in Table 7. 

The question may arise as to the 
possible effect of aphasic disturbances on 
the obtained test results. The brain dam- 
aged group included only two cases with 
a history of such disorders. Both were 
excluded from the obtained results to 
determine their effect on the final “t” 
values. In every case their exclusion 
tended to slightly increase the obtained 
differences. 

Inter-group comparisons have also 
been made on the basis of age, level of 
education, and pre-injury occupation. 
From each of these aspects the two groups 
do not appear to have any outstanding 
differences. 

Finally all of the brain damaged cases 
received their injuries at least six months 
prior to testing. Accordingly, any differ- 
ences that may be found are not the re- 
sult of a transitory condition but reflect 


TABLE 8 
Age and education distributions 








Brain 
Injured Cases 


Neurotics Normals 





Educational Level 





Levels 


N 





Below Eighth Grade 
Eighth Grade 

Ninth to Eleventh Grade 
High School Graduate 
College Level 























Below 19 Years of Age 
20-24 Years of Age 
25-29 Years of Age 
30-34 Years of Age 
Over 35 Years of Age 
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relatively permanent residuals of the in- 
jury. 
C, RESULTS 


I. Memory Tests 
The sub-tests to be discussed are pre- 
sented in actual testing order. 
The first to be considered is a test of 
memory. This type of item was included 
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TABLE 9 
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levels (31). It is, omitting articles and 
conjunctions, a 67-word story of a mili- 
tary nature. The content is well organ- 
ized, cohesive, and interesting. Proper 
names, distances, times, directions, etc., 
are included but there is no part or sec- 
tion that introduces the principle of “‘iso- 
lation”. 

The directions are simple, The subject 


Occupational distribution 











Brain Injured 











Controls 
Occupations Ree ne ‘Cases 
N % N 4% 
Architect “ I 2.3 
¢ Baker 2 3.9 
¢ Carpenter 2 3-9 
Clerk I 2.3 4 7.8 
Dentist “ I 2.0 
Farmer 9 20.5 4 7.8 
Hotel Manager © \ I 2.3 
Laborer 14 31.8 14 27.5 
S Lithographer I 2.0 
Machine Operator 6 13.6 
Mechanic (auto) 5 11.4 4 7.8 
Musician ~ I 2.3 
vw’ Salesman 9.8 
Student 5 11.4 II 21.6 
Teacher ~ 2 9 
s Welder .O 





for two reasons; (1) A number of the 
patients indicated that their ability to 
retain and recall had been altered by the 
injury sustained. The nature of these 
complaints ranged from memory lapses 
such as forgetting to mail a letter, to the 
inability to recall what had just been 
read or heard. (2) The MAS, like the 
W-B, does not have a direct memory test. 
As pointed out by Rapaport “. . . the 
most serious shortcoming of the Bellevue 
Scale is the fact that it contains no sub- 
test which tests memory function in a 
more direct way than the information 
sub-test” (23). 

The item is similar to those used in 
the Terman and Merrill revision of the 
Stanford-Binet at the X year and SA II 








is told that something is going to be read 
and that when it is finished he is to tell 
the examiner all that he can remember 
about it in his own words. Just prior to 
the reading, there are the usual cautions 
to insure the patient’s attention, The 
selection is then: read. Care is taken to be 
sure that the reading rate, for the entire 
selection, falls vetween 35 and 40 seconds 
for every subject. The examiner should 
avoid a bored or affected tone and obvi- 
ously emphasis should not be placed on 
names, distances, directions, etc. Scoring 
is similar to that used in the Binet. On 
the score sheet the story has been broken 
down into nearly equal thirds. Every 
third includes ten “memories” with the 
exception of the last. ‘These are checked 
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by the examiner as they are related. A 
degree of leeway is allowed. That is, if 
the patient has expressed the essential 
element of a “memory” but the wording 
is not identical, credit is given. However, 
dates, times, distances, directions, names, 
etc., have to be absolutely accurate to 
obtain credit. Following the free associ- 


disorders of form and organization of 
thought such as circumstantiality, block- 
ing, impoverished thinking, persevera- 
tion, rambling, pseudo-profundity, and 
confabulation. Also variations in the rate 
and progression of the stream of thought 
can be detected. In short, the item can 
be evaluated quantitatively and qualita- 


TABLE 10 


Distribution constants obtained in quantitative 
analysis of the memory test 









































Brain Injured Neurotics Normals Total Controls 
7 
M S.D. M S.D. M S.D. M S.D. 
1st } Free Association 3.66 2.00 5.56 2.15 5.20 1.89 5.31 1.99 
2nd 4 Free Association | 2.91 2.20 4-94 2.41 4.80 2.12 4.84 2.22 
3rd $ Free Association | 2.95 1.92 | 4.19 1.81 4.89 1.60 4.67 1.70 
Total Free Association | 9.52 4.86 14.69 4.74 14.89 4.25 14.82 4-41 
Questions 6.86 ky, 9.25 2.33 0.54 2.30 9.45 2.31 
Total Memory Score 16.39 7.82 23.04 6.24 24.43 6.04 | 24.27 6.11 





ation period, a series of seven questions 
are asked, These require specific infor- 
mation about the story, and the answers 
must be perfect. The total score is a total 
of credits received for the free association 
and the direct questioning. 

This type of memory item was chosen 
for the following reasons; (1) it is a test 
of memory for meaningful material. (2) 
It gives the clinician a glimpse of the 
patient’s ability to organize this type of 
material into a unified, integrated whole. 
There is a definite possibility for analysis 
from this viewpoint; i.e., are the “memo- 
ries” disorganized and given in a random 
order or is the organization factor so 
compelling that only the bare outlines 
are given and the details ignored? (g) 
Much rich data may be obtained from 
this type of test. The associations that are 
aroused may be definite therapeutic 
leads. It has occasionally happened that 
the patient’s reproduction has given a 
definite clue as to the cause of his affec- 
tive disorder. The test also has been 
found to be fairly sensitive to certain 


tively. In discussing each of the sub-tests 
the quantitative aspect will be considered 
first. 

The data obtained from the memory 
test has been subdivided in such a man- 
ner that the results from the free associ- 
ation and the questions have been ~ 
considered separately as well as in combi- 
nation (total score). In Table 10 the dis- 
tribution constants for each group are 
given. As is indicated, the free association 
data has been divided into thirds, This 
was done to determine whether such 
factors as primacy and recency operated 
in the same manner for each of three 
groups. It is apparent that more was re- 
tained of the first and final thirds than of 
the intervening section. This held for 
all three groups and the ratio in each 
case was virtually identical. It may be 
well to point out that although the mean 
of the final third of each group was ap- 
proximately the same as that for the 
middle section, it contained one less 
“memory” than either the first or second 
subdivision. It was prorated on this basis 
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and the resultant mean was found to for comparative purposes. As is indicated 
be higher than that for the middle sec- by the control-brain injured group com- ’ 
tion. parison, the obtained variance was highly 
The percentage of the brain injured _ significant from a quantitative stand- 
and control patients correctly answering point. However, when dealing with 














TABLE 11 


Percentage of the brain injured and control patients 
answering the questions correctly 











Brain Injured Controls 
Questions Diff. D / ae 
N % N % ‘ 


























I 19 43 32 63 20 1.98 
2 38 86° 51 #i00 14 2.69 
3 25 57 40 78 21 2.21 
4 II 25 33 65 40 4.26 
5 II 25 21 4! 16 1.68 
6 8 18 14 27 9 1.06 
7 3-65 


34 77e 51 #100 23 


















each of the seven questions is given in groups as small as have been used in 
Table 11. The percentage differences ob- this study it is necessary to determine 
tained consistently favor the controls whether the means that have been ob- 
and are either clearly significant or indi- tained are good measures of central ten- 
cate definite trends in all but two in- dency, That is, it is possible that the 





TABLE 12 


Significance of mean differences 











Neurotics vs. Controls vs. 
Normals Brain Injured 
















Diff. sa Sd Diff. “eo 

















1st $ Free Association 36 -59 1.65 4.00 
2nd 4 Free Association .14 .20 1.93 4-14 
rd 4 Free Association .70 1.36 1.71 4.58 
otal Free Association .20 $s 5.30 §-53 
Spemtogs 29 -41 2.59 4-38 
otal Memory Score .49 . 26 7.89 5.48 

















stances. In these cases the questions are averages have been affected by the pres- 
evidently too difficult to be discrimina- ence of a few extremely low or high 
tory. scores. To check this possibility the total 
Significance of the mean differences memory test raw scores were plotted and 
was computed and the results are given the results are shown graphically in 
in Table 12. The neurotics and normals’ Figure 1. Unquestionably a_ bimodal 
do not appear to differ in any respect. curve has resulted and in general the 
Although this was suggested by their scores appear to be well distributed in 
means, it was considered best to make each of the two groups. 
this test before the two groups were com One other fact of interest can be read- 
bined into the control group and used _ ily derived from the graph. A number of 
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the brain injured patients obtained scores 
near or above the average of the control 
group and the converse situation is also 
true. It is apparent that given a total 
test score it would be impossible to 
classify every patient as brain injured or 














scores. Upon first consideration, a zero 
score would seem to be nearly impossible 
provided the subject was making an ef- 
fort. However, the examiner had known 
these patients for a considerable period 
of time prior to testing, and excellent 


22-14 115-17 118-20 [21-23 


RAW SCORES 


Fic. 1. Graphic distribution of total memory raw scores for the brain injured and control groups. 
Key: Solid Columns = Controls 


not brain injured with a satisfactory de- 
gree of certainty. 

Qualitatively the test was productive. 
Four of the brain injured cases during 
the free association period gave stories 
that bore little relationship to the one 
that was read to them. However, they 
retained enough of the original story to 
receive some credit. In every instance 
the confabulation had a central idea or 
theme and was fairly coherent and co- 
hesive, but in each instance elements of 
circumstantiality, preservation, and 
pseudo-profundity were present. When 
asked the series of questions, three pa- 
tients became indignant and asked how 
they were expected to answer questions 
about something that had not been read 
to them. A fourth person gave answers 
to each question, none of which were 
related to either the original story or his 
version of it. Three others received zero 


rapport had been established. None of 
them were excessively concerned over 
their failure, having previously experi- 
enced such lapses of memory since their 
injury. After inquiry it was found that 
other patients had noted their difficulty, 
especially in connection with radio pro- 
grams. If a play or a dramatized current 
event were being presented, these pa- 
tients would forget characters and also 
events that had occurred earlier in the 
program. They often became hopelessly 
confused and continually asked others 
for information about what had previ- 
ously happened, or who a character was 
and how they were connected with the 
story. At the other extreme, three of the 
brain injured patients obtaining the 
highest scores did not confine their efforts 
to repeating the content of the original 
story but embellished it to the point of 
giving a partial life history of every char- 
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acter involved, what occurred before the 
story started and what happened after 
its completion. Other brain injured pa- 
tients exhibited a condition which ap- 
proximated impoverished thinking or 
brevity of associations. Their reproduc- 
tions were the bare essentials. However, 
a surprising number of scoreable answers 
were often given if the patients were en- 
couraged. 

Finally it was found that if a few hints 
were given after the questions had been 
asked and scored, the majority of the 
controls were able to increase their origi- 
nal score considerably. However, when 
the brain injured group was allowed the 
same aids very little improvement re- 
sulted. 

The use of this type of memory test 
has demonstarted the existence of certain 
qualitative behavioral differences as well 
as a highly significant quantitative inter- 
group score variance. The degree to 
which the former is characteristic of 
brain damage and the validity of the 
latter will be discussed later in the pa- 


per. 


II. Trail Making Test 


The second sub-test has two parts (A 
and B). Part A consists of a sheet of paper 
on which there is printed a series of 
circles. In the center of each of these is 
a number, with a range for the test 
proper from 1-25, and for the sample 
which is on the opposite side of the page, 
from 1-7. These circles are spatially ar- 
ranged in a random order. The patient 
is given a pencil and the test is placed, 
sample side up, in front of him. The 
examiner then tells the subject that his 
task will be to draw a line from 1 to 2, 
from 2 to 3, from 3 to 4 and so on, in 
order, until the end is reached. Each 
numbered circle is pointed out as it is 
referred to, but an imaginary line from 
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point to point should not be traced with 
either a finger or pencil. The subject 
then performs the task for the sample, 
which gives ample indication of whether 
or not the directions have been compre- 
hended. The paper is then turned over 
and the previously given directions re- 
peated. The patient is told that the test 
is to be completed as rapidly as possible. 
He is cautioned that if a mistake is made 
to cross it out or erase it as rapidly as 
possible and keep on going. 

Part B is similar in structure to Part 
A, but there is a definite difference inas- 
much as the test and sample have both 
numbered and lettered circles presented 
in a random order, Following the proced- 
ure outlined above the directions given 
for a sample and test proper are as fol- 
lows;—Draw a line from 1 to A, from 
A to 2, from 2 to B, B to g, etc. The ex- 
aminer carefully indicates the sequence 
of number-letter, number-letter to the 
patient. Again care is taken to point to 
each circle but not to trace a line with a 
finger or pencil. After the sample has 
been satisfactorily completed, the page 
is turned over. The directions are re- 
peated, and the patient is told to work 
as rapidly as possible and if any error is 
made to cross it out or erase it as quickly 
as possible and to continue. 

When administering the Army Individ- 
ual Test the examiner removed either 
part of this test when the patient, after 
making an error, does not notice and 
correct it before he has proceeded beyond 
three more circles (4). This procedure 
has been altered. As the item in this in- 
stance is being used to study the effects 
of brain injury, all possible behavioral 
data was collected, In every case the pa- 
tient was allowed to complete the test. It 
was of interest, for example, to see how 
often the sequence in Part B of number- 
letter would be lost. Therefore after the 
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test had been failed according to the cri- 
terion above, the patient was encouraged 
and the number-letter relationship re- 
established. It was also felt that remov- 
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ever, there may be a carry-over effect 
from Part A, which required only a num- 
ber to number sequence. If the subject is 
rigid, perseverative, or unable to shift, 


TABLE 13 


Distribution constants obtained in quantitative analysis 
of the trail making test 











Brain Injured 


Neurotics 


Normals Total Control 





M S.D. M 


S.D. M S.D. M S.D. 





Trail Making A 6.93 
Trail Making B 1.86 
Total Score 8.80 


3.26 
2.08 


9.56 
5.56 














ing the test increased sense of failure and 
inadequacy, which in our opinion, 


should be avoided. 
The test was selected because it seemed 
to measure the following functions: (1) 


.68 
2.75 
2.97 


9.76 +73 
5.88 2.68 
15.65 2.96 


-79 9.86 
2.50 6.03 
a, 2-85 15.89 




















it is easy to envision the difficulty that 
will be involved. However, after failure 
on Part B, it is necessary to determine 
whether or not the subject actually knows 
the sequence of letters in the alphabet 


TABLE 14 


Significance of mean differences 











Normals vs. 
Neurotics 


Controls vs. 
Brain Injured 





sia 


Diff. 





Trail Making A 
Trail Making B 
Total Score 


1.34 
$7 4.02 
.84 6.85 


2.83 





Ability to perceive a double relationship, 
(2) Ability to plan, (3) Ability to “shift”, 
and (4) Related to the preceding point, 
the presence of any perseverative tend- 
ency. 

In order to do well on the test it is 
necessary always to look ahead, and be- 
fore the test is started, to form a quick 
over-all plan. The subject who draws a 
line from 1 to 2, on reaching 2 begins 
looking for 3, and repeats this procedure 
over and over will do rather poorly be- 
cause of the time factor. 

In part B the subject must completely 
understand the number-letter relation- 
ship for successful performance. How- 


in order to rule out failure on this basis. 

The scoring is simple. Each part is 
evaluated from the standpoint of time 
and accuracy. If no errors are made, or an 
error is corrected very quickly, the score 
obtained depends directly on the speed 
with which the test was completed. If 
the item is accomplished in less than 20 
seconds a maximum score of 10 is given; 
however, if longer times are taken partial 
credits are given, depending upon the 
rapidity of completion. Zero scores are 
awarded only when uncorrected errors 
are committed. 

As is indicated by the distribution con- 
stants in Table.13 a marked variance ex- 





















isted between the controls and the brain 
injured groups. As a matter of interest, 
the mean score for the controls on the 
Trail Making A alone, exceeds the mean 
total score (Trail Making A & B) ob- 
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TABLE 15 
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usually able to recognize and correct 
them quickly. In reference to this last 
point it should be made clear that on 
Trail making A and B only two of the 
brain injured cases ever realized that an 


Number and per cent of subjects making and correcting errors 








Trail Making 
A 





Groups 


Errors 











Brain Injured 12 27 7 
Neurotics 3 19 3 
Normals 2 6 2 
Total Controls 5 LO 5 





tained by the brain damaged cases. The 
degree to which these differences are to 
be considered significant is presented in 
Table 14. The raw scores have been plot- 
ted for parts A and B as well as the total. 
In each case (Figures 2, 3, and 4) definite 
bi-modality has resulted and the means 
do not appear to have been unduly in- 
fluenced by the presence of extreme 
scores. 

It was considered of interest to com- 
pute the number of errors committed and 
from this data determine the percentage 
of cases in each group that were able to 
recognize and correct their errors before 
failure occurred. The appropriate results 
are given in Table 15. 

Considering the Trail making A first, 
the percentage difference in respect to 
the total number of errors made did not 
reflect a significant variance, but the per- 
centage of the two groups that were able 
to correct their errors did. As for the 
Trail making B both aspects considered 
above yielded significant differences. In 
general, the controls tend to make less 
errors, but more important, they are 


Errors 
Corrected 








Trail Making 
B 











Errors 


Errors Corrected 
















es 





% N % N % 





58 25 57 7 28 
100 4 25 4 100 
100 10 29 7 7° 
100 14 27 II 79 








error had been committed, Their errone- 
ous test performance seemed completely 
adequate to them. Finally four of the 
five errors that the controls made on 
Trail making A were caused by the omis- 
sion of circle number 24. That is, in their 
haste to finish the test, they would draw 
a line directly from 23 to 25. None of 
the errors made by the brain damaged 
patients were of this nature. 

The number of errors that were com- 
mitted on the sample of both parts of the 
test were determined but these were 
evenly distributed. 

The comparative performance of the 
two groups was very interesting. Un- 
questionably the outstanding reason for 
the low mean of the brain injured group 
on Part A was their lack of planning 
and anticipation. Most of the control 
cases would look at the test to get some 
over-all idea of the position of the circles 
and their inter-relationship before the 
test was started. In addition they would 
constantly look ahead so that while draw- 
ing a line between any two numbers they 
would be locating the next in the se- 
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quence. This we believe is similar to the 
anticipation and planning aspect neces- 
sary for excellent performance with the 
Object Assembly sub-test of the W-B. If 
the whole is recognized in terms of its 
parts and integrated before actual mani- 
pulation has begun, the object will be as- 


—eQunacaunxas 





RAW 3CORES 
Fic. 2. Graphic distribution of the 
trail making (A) raw scores. Key: 
Solid Columns = Controls. 
sembled more rapidly than if a haphaz- 
ard approach is made. We have chosen 
to call this behavior “planning ahead” 
and it is probably an aspect that might 
well be included under the general head- 
ing of anticipation. The brain damaged 
patients on the other hand, would im- 
mediately start drawing a line from one 
to two. At this point they would stop and 
search for three. This method would be 
repeated over and over until the test was 
completed. This failure to “plan ahead” 
seemed to be responsible for go% of the 
errors that they made. When they would 
stop to look for the next number they 
would use the pencil as a pointer. After 
the correct number had been located, 
they would often either begin again from 
the located circle or return to an in- 


correct circle and continue from that 
point. 

Trail making (B) definitely introduces 
a dual relationship. Most of the errors 
made by both groups can be attributed 
to the failure to adequately deal with 
a two aspect problem. There is consider- 
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RAW SCORES 
Fic. 3. Graphic distribution of the 
trail making (B) raw scores. Key: 
Solid Columns = Controls. 

able evidence that rigidity and persevera- 
tion are characteristic of the brain dam- 
aged patient. With this in mind it would 
seem that the number-number sequence 
of the Trail making A should have con- 
siderable effect on the performance of 
Trail making B. However, failures due 
to a letter to letter sequence occurred as 
often as number to number failures. 
Most of the brain injured cases who did 
correctly complete the test, did so very 
slowly. They constantly repeated aloud 
the formula “number-letter” as they 
worked. The examiners noticed this in 
almost all of those that did succeed in 
addition to those who became confused. 
In spite of this constant reminder most 
of them lost the relationship before the 
test was completed. In these instances 
they would retrace part of the record or 
start again from the beginning. 
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When discussing the administration of 
the test it was pointed out that the ex- 
aminer always permitted each part to be 
completed rather than to withdraw the 
test after an error had been made. This 
was done for two reasons (1) to prevent 
feelings of failure and (2) determine the 
number of times the number-letter rela- 
tionship would be lost before the test 
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RAW SCORES 
Fic. 4. Graphic distribution of total 


trail making raw scores. Key: 
Solid Columns = Controls. 


was completed. It was found that those 
who failed averaged three errors, in addi- 
tion to the original, before the test was 
finished. Some never were able to retain 
the sequence over two or three circles. 
These had to be constantly prompted. A 
very few did not make further errors but 
worked so slowly that if no error had 
been made at all their score would have 
been one instead of zero. Each of the 
controls making errors was able to com- 
plete the test without further difficulty. 


III. Patch Test 


The third item requires the duplica- 
tion of nine colored, circuiar patterns 
which resemble shoulder patches worn 
on the Army uniform. One of the nine 
serves as a demonstration item and the 
other eight compose the test proper. The 
materials necessary for the duplication 
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consists of nineteen paper circles of dif- 
ferent colors. Some of these are solid 
while others have different sections of the 
interior part removed so that by placing 
them one on top of another, a pattern 
may be formed. 

The test materials are arranged in 
front of the patient in a standard order. 
This is facilitated as each circle is num- 
bered. After the test materials have been 
properly placed, the examiner exposes 
the demonstration patch. It is pointed 
out that the design resembles a shoulder 
patch and that it can be made by putting 
together some of the circular cards in 
front of the subject. The examiner then 
demonstrates the correct solution. The 
pieces are then returned to their proper 
places and the patient is asked to dupli- 
cate the same design. Following this the 
subject is told that other patches will be 
exposed and it will be his task to correct- 
ly duplicate each of them. He is told that 
his solution must have exactly the same 
shape and color as the test patch that has 
been exhibited and that he may use as 
many of the circular pieces as necessary. 
The first test patch is then turned up. 
Ample time is allowed for construction 
and added time credit is given if the de- 
sign is completed quickly. The eight test 
designs are in graded order of difficulty. 
The first one is extremely easy and al- 
though it adds absolutely nothing, in a 
statistical sense, to the validity of the 
item, it is invaluable as a confidence 
builder. Each patient can see the,results, 
is aware that he has completed the first 
task correctly and through success devel- 
ops enthusiasm for the test. 

The test is terminated after two fail- 
ures regardless of whether or not they 
occur successively. However, we have not 
withdrawn the test patch when the al- 
lowed time limit has been reached and 
the design has not been reproduced. In- 
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stead the examiner has given minor sug- 
gestions leading to the correct solution. 
The actual number of designs available 
for duplication is never mentioned, so 
that the final failure always occurs on the 
“last” design in the series. The scoring is 
on the basis of accuracy and time, al- 
though for observational purposes and 
to escape a feeling of frustration or dis- 
appointment on the part of the patient, 
he is actually allowed as much time as he 
needs. The test was included as it seemed 
to provide a means of sampling: (1) 
analysis and synthesis; (2) ability to shift; 
(3) ability to stick to a point, and (4) 
possible perseverative trends. To what 
extent each of these abilities enter into 
the final solution cannot be determined. 
Obviously, the basic abilities will be 
those of analysis and synthesis. However, 
the assembly of certain of these patterns 
is much more complicated than the 
Wechsler-Bellevue Block Design Test. It 
must be remembered that these patterns 
are being built up in depth and that in 
placing pieces one on top of another, 
parts are being blocked out. This means 
that the design, though rather simple 
to break down, must be assembled in 
terms of parts of the nineteen circular 
pieces and these sections of the whole 
discs may be far from apparent. This is 
illustrated by Figure 5. Although the 
bottom pattern is not a true test design 
it will serve to make clear the difficulty 
involved. In the actual test situation each 
design, with one exception, can be dupli- 
cated only by putting together specific 
discs of the 19 provided, These must be 
chosen from a number whose characteris- 
tics are similar to the parts of the actual 
test patch. Although most of the patterns 
are simple to amalyze, a few are very 
difficult. The difficulty consists largely 
in determining what is figure and what is 
ground. If the subject starts with an as- 


sumption that is incorrect and has lost 
the ability to “shift”, failure usually fol- 
lows. Some designs are more easily solved 
if the patient begins by selecting the top 
piece; others are assembled more easily 
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Fic. 5. Illustration of a patch assembly. 




















from the bottom up, If the same ap- 
proach is employed in every case, it 
creates an added hardship. The aspects 
and functions necessary for success will 
be discussed in greater detail when con- 
sidering the brain injured patients’ per- 
formance. 

The distribution constants and signi- 
ficance of mean differences are presented 
in Table 16. A highly significant variance 
was found to exist between the control 
and brain injured groups. This, being 
true it was of interest to determine 
whether any one or two of the designs 
were responsible for the poorer scores 
obtained by the brain damaged patients. 
The percentage distribution of each 
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group successfully assembling the indi- 
vidual designs is shown in Table 17. 
The results suggest that the patterns were 
arranged in order of difficulty and each 
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As a further investigation the distribu- 
tion constants and significance of mean 
differences were computed for the actual 
time taken to assemble the patterns. With 


TABLE 16 


Distribution constants and significance of mean differences 








Neurotics 


Brain Injured 
M S.D. 


Test 





S.D. 


Total Controls 
M S.D. 


Normals 


M S.D. 











Patch 10.28 6.13 17.00 
s Neurotics vs. Normals. 
Difference 26 


it 5 .20 


4.46 


4.08 16.82 
Controls vs. Brain Injured 


6.55 
6.04 


16.74 4.20 





of them appears to have contributed pro- 
portionally to the lower mean of the 
brain injured group. Evidently the first 
and last two patches add little to the 
test’s ability to discriminate between the 


the exception of the first design no sig- 
nificant differences were found. These 
results are similar to those that were de- 
termined in an earlier study of the MAS 
(1). Both the Patch and the Block Designs 


TABLE 17 


Percentage of the groups correctly assembling each patch 
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Difference D/ SD 
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two groups. The first is much too easy 
and the last two are too difficult. 

A final quantitative check was made to 
determine whether the controls and 
brain injured cases who were able to 
correctly construct the designs, differed 
in relation to the speed with which they 
were able to assemble the patterns. With 
the exception of the first design, the re- 
sults indicate (Table 18) that if the brain 
injured patient is able to duplicate the 
pattern, he does it quickly enough to ob- 
tain as much time credit as do controls. 


tests seem to operate according to an “all 
or nothing” principle. That is, either the 
designs 6r patches are solved with normal 
speed and accuracy, or they are not solved 
at all. 

Continuing the same procedure as was 
established in the treatment of the mem- 
ory data, the raw scores of the patch test 
were plotted for both groups. Again a 
bimodal curve resulted (Figure 6). How- 
ever, as was found before, a number of 
brain damaged cases obtained scores near 
or above the mean of the controls and 
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vice versa. The scores of both groups ap- 
pear to be well distributed and it does 
not seem that the means have been un- 
duly affected by the presence of a number 
of extreme scores. 
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differences are, however, a matter of de- 
gree rather than an attribute of any 
group. 

The second qualitative observation was 
the relative inability of the brain dam- 


TABLE 18 


Percentage of both groups obtaining time credit 








Brain Injured 
Patched 


Controls 


D/SDairs 


Difference 
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73 
57 
76 
59 
54 
40 
67 
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.39 
.09 
-79 
.03 
-21I 
-12 
.66 





Qualitatively, a number of definite dif- 
ferences between the groups were no- 
ticed. Time and time again the brain in- 
jured patients would begin by selecting 
a number of pieces which would be ar- 
ranged in a variety of ways; these would 
be discarded and others selected, but al- 
most immediately they would return to 
the ones they had chosen originally and 
proceed to arrange and re-arrange them 
as had been done before. This entire 
procedure would often be re-enacted un- 
til the time limit had been exceeded. 
This inability to shift not only operated 
in the manner outlined above but ex- 
tended to the inability to rearrange pieces 
and rigidity in approach (persistently 
starting from top or bottom regardless of 
success achieved) from design to design. 
This perseverative and rigid behavior 
was also noticed in a number of the con- 
trol cases. However, the controls could 
and did salter the order of the cards, 
select new pieces, and if the pattern was 
not readily assembled in starting from 
the top, they would try it from the bot- 
tom. In general it is suggested that these 


aged patients to deal effectively with a 
dual relationship. The completed assem- 
bly must have the same form and color 
as the original to receive credit. Very fre- 
quently the form would be correctly du- 
plicated but the color would be disre- 
garded. On the other hand, tke colors 
might be the chief concern and the form 
would be ignored. 

Third was the lack of plan. The brain 
damaged patient showed less of an inte- 
grated or unified approach. A definite 
plan or method was obvious occasionally, 
but it was so nebulous that when the 
slightest difficulty was encountered the 
entire approach often disintegrated. 

Fourth was the brain injured patients’ 
seeming inability to analyze the pattern 
to be duplicated. A number of the pa- 
tients would look at a design and say, 
“red is the bottom”, and pick up a red 
piece when actually a yellow one was 
needed. The fifth was the inability to 
synthesize. In these instances the patients 
would make the correct assumptions but 
would be unable to select certain cards 
having parts necessary for successful com- 
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pletion. Usually a partially correct solu- 
tion would be offered in these cases. 
The sixth was a dual factor. Some of 
the brain injured cases arrived at the 
correct solution, but they worked so slow- 
ly that they failed to receive credit. Fail- 
ure was due directly to slowness in trying 
the various pieces. On the other hand, a 
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Fic. 6. Graphic distribution of 
patch test raw scores. Key: 
Solid Columns = Controls. 


number worked so quickly that they 
would correctly assemble a design and 
then tear it down before they realized 
that they had correctly duplicated the 
patch. This behavior was also occasional- 
ly noticed among the controls, especially 
in the neurotic group. 

Finally, there was the effect of help 
or the factor of learning. If one of the 
patches early in the series was failed, the 
examiner demonstrated the correct as- 
sembly. Most of the controls were greatly 
aided and applied the observed tech- 
niques to the next design. The brain 
damaged patient on the other hand, rare- 
ly gained anything from watching a pat- 
tern duplicated. 

The types of behavior just described 
are neither arranged in order of fre- 
quency or importance. Obviously these 
are not all the behavioral variances that 
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occurred, but they are the ones that were 
observed most often. It was quite clear 
to the examiners that none of the factors 
described above was the sole cause for 
failure. The extent to which each may 
have been responsible is a subjective con- 
sideration and any assumptions that 
might be made would in all probability 
be misleading and inaccurate to some ex- 
tent. 


IV. The Goldstein-Scheerer Cube Test 


The fourth sub-test we have used in 
our screening device is the Goldstein- 
Scheerer Cube Test (9). The material 
consists of four one inch, vari-colored, 
square, wooden blocks and a series of 
colored designs, adopted from those de- 
veloped by Kohs (18). The procedure in 
administration is familiar to every clini- 
cian, After placing the four blocks be- 
fore the subject, the examiner states that 
they are all alike, i.e., on one side they 
are all red, another side all blue, another 
side yellow and blue, etc. The examiner 
must be sure that the subject understands 
that each block is like every other one. A 
design is then placed before the subject, 
and he is asked to duplicate the design us- 
ing all four blocks. Thereafter no further 
instructions or aids are given the subject. 
Every move, block placement, and evi- 
dence of trial and error behavior are 
recorded as completely as possible. If the 
design has not been satisfactorily dupli- 
cated in three minutes, the design is re- 
moved. The examiner says, “Let’s put 
this one aside and try another. We will 
return to this one later”. Because brain 
injured patients frequently show overt 
manifestations of frustration as a result 
of failure, it is wise to avoid accentuation 
of poor performance. After the series of 
twelve designs have been attempted 
(Step I), the next step is used if necessary. 
In Step II the designs are the same size 
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as the blocks, but are in no other way 
different from the designs used in Step 
I. Only the designs failed in Step I are 
repeated, If any failures occur, Step IIJ 
is presented, In this step, the designs are 
again the size used in Step I, but heavy 
black lines have been drawn through the 
pattern to indicate the exact position of 
each of the four blocks. If any of these 
are beyond the subject’s capability, Step 
IV is administered. The designs in this 
step also have the heavy black lines to 
indicate the block positions, and in addi- 
tion are the size of the actual blocks. 
Failure at this point terminated the for- 
mal test presentation as far as this study 
was concerned, although Goldstein de- 
scribed a further step of having the sub- 
ject attempt the reproduction of a pat- 
tern made up of actual blocks. In our 
cases the examiner placed one block in 
its correct position upon the design, and 
asked the subject to do the same with the 
remaining blocks. This was done to per- 
mit an eventual solution and thus re- 
lieve the_subject’s sense of failure. 

This item has been included in the 
test for three reasons: (1) Because of the 
intellectual functions tested. Goldstein 
and Scheerer (g) believe that in general, 
success depends upon the ability to as- 
sume the “abstract attitude”. A discus- 
sion of this term appears in their mono- 
graph, It is our opinion that it resolves 
ultimately to the ability to analyze, syn- 
thesize, anticipate, plan and shift. This 
last function is extremely important 
when designs number 7, 10, 11 and 12 
are reached. These are diamond shaped 
rather than square. The subject has con- 
structed all previous patterns at a 180° 
angle, The presentation of the diamond 
shaped designs necessitates a shift or 
change in approach. The need for analy- 
sis or synthesis is obvious and does not 
require explanation, A number of rea- 


sons for failure are given by Goldstein 
and Scheerer. These seemingly overlap 
to such an extent that direct application 
becomes difficult. (2) To check Gold- 
stein and Scheerer’s statement, “patients 
suffering from functional disturbances of 
the brain cortex are not able to adopt 
the specified abstract attitude required 
in this test” (9). This assumption has 
been contested by Halstead (11) who has 
noted that patients with frontal injury 
have been able to think in a definite ab- 
stract manner. (3) To attempt to deter- 
mine the practicability of formulating a 
method of scoring to enable validity de- 
termination. A clinician does not select 
tests at random. They are chosen be- 
cause they are known to tap certain func- 
tions and fulfill certain diagnostic needs. 
Reliabilities and validities have been es- 
tablished to determine the measure’s 
limitations. It is not enough to describe 
behavior, one must know the significance 
of its characteristics and the frequency ot 
occurrence in similar cases. 

The basic premise of this paper is thatl 
it is necessary and valuable to observe 
the brain injured person as an integrated 
whole. This does not necessitate disre- 
gard of statistical aid in ana” 
data that has been collected. 

The first approach was to determine 
the number of control and brain injured 
cases that failed each of the four steps. 
These results are given in Table 19. Most 
of the brain injured group were able to 
adopt the necessary “abstract attitude” 
and of those that did fail Step I only a 
few were unable to alter their behavior 
before the final step was reached, It is of 
interest that nearly all of the controls 
that failed the first step did not require 
Step II. That is, they recognized their 
errors and upon re-presentation of Step 
I they were able to successfully duplicate 
the patterns, Some of the brain injured 
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patients were also able to do this. Indica- 
tions were present that learning did take 
place in both groups but to a different 
degree. The foregoing did not apply to 
those brain damaged cases failing designs 
10, 11 and 12. Each of these required 
the administration of Step II. These de- 
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ing device. However, we realize that cer- 
tain limitations may have been placed 
on the test by such aspects as the type 
of case used, recency of injury, locus of 
lesion, etc. To determine whether the dis- 
criminatory ability of the item could be 
increased, a multiple approach was made 


TABLE 19 
Number and per cent of both groups failing the first four steps of the 
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signs particularly emphasize the ability 
to shift. It was found that fourteen of 
the brain injured patients tended to con- 
tinue to construct designs 10 and 11 in 
the same position as those preceding, and 
sixteen patients had the same difficulty 
with number 12. In each case eight of 
them were unable to shift their mode of 
attack and therefore failed. In every in- 
stance the design was correctly assembled 
but was not placed at an angle. All but 
three that failed design 7 did so for the 
above reason—the others were .concerned 
with the necessity for a white background 
or offered a single block as the solution. 
It would appear that in general failures 
due to inability to break the design down 
and reassemble it were relatively few in 
number. 

These quantitative results were disap- 
pointing from the standpoint of a screen- 


in an attempt to devise an objective scor- 
ing system. First the distribution con- 
stants and the significance of mean dif- 
ferences for the time taken to complete 
each design were computed. This pro- 
cedure was applied only to the data ob- 
tained from those successfully complet- 
ing the design at the first level. The 
second was an attempt to determine the 
number of incorrect moves that were 
made by both groups. The third was a 
study of the order or sequence employed 
in placing the blocks. That is, did the 
patient always work from top down and 
left to right or exhibit some other order 
that was regularly employed? Finally the 
number of correct first block placements 
were determined. None of these methods 
uncovered differences that were signifi- 
cant. In general the results indicated that 
if the patient was able to duplicate the 
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design it was done with normal facility. 

Qualitatively the behavior observed 
was as described by Goldstein and 
Scheerer (g). No attempt was made to 


give the examiner an indication of the 
patient's pre-injury intelligence. This was 
found to be necessary because a few of 
the cases tested, who were of low intel- 


TABLE 20 
Intercorrelations among the MAS sub-tests 
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classify the failures according to the 
causes listed by them. It was felt that 
such subjective categorization made the 
reliability and validity of the indications 
given of questionable value. 


V. The Stanford-Binet Vocabulary 
Test 


The final sub-test is the Stanford-Binet 
vocabulary test (31), It was included to 


ligence, were found to display behavior 
and obtained scores similar to those of 
the brain injured patients. However, we 
did not have enough of these cases to 
present any definite results. It is possible 
that some characteristic behavior exists 
which may serve to differentiate between 
these two entities. Until this point can 
be resolved, the vocabulary test must be 
relied upon for this purpose. The de- 
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ficiencies of such technique have already 
been discussed. 

In most instances we have found that 
it is possible to dispense with this item. 
Previous employment, education and 
other data usually supply sufficient in- 
formation regarding the patient’s approx- 
imate pre-injury level. However, a few 
cases were encountered in which the 
necessary data could not be obtained. 
Here the vocabulary test was found to be 
helpful. 


VI. Sub-Test Interrelationship 


Quantitatively, a final approach was 
the determination of the degree of sub- 
test interrelationship which existed for 
both the MAS and the proposed screen- 
ing test. Table 20 presents the MAS in- 
tercorrelation coefficients. Included is a 
Wechsler-Bellevue matrix adapted from 
that given by Wechsler (32). There are 
several points of interest: (1) The extent 
to which the brain damaged and control 
matrices are similar; (2) the W-B and 
MAS coefficients appear to agree basi- 
cally; and (3) if those sub-tests found to 
be diagnostic are considered, a very 
high average correlation is found to exist 
for the brain injured and control groups, 
the brain injured mean being slightly, 
though not significantly, higher. 

The first point is added suggestive evi- 
dence that the difference between the 
groups is purely quantitative. However, 
factor analysis technique should be ap- 
plied to this data. Results so obtained 
might provide evidence as to whether 
any functions had been actually lost or 
dropped out of the pattern. 

The second point adds support to pre- 
vious findings (1) that the W-B and MAS 
are interchangeable instruments. In ad- 
dition W-B’s had been administered to a 
number of control and brain injured pa- 
tients who had previously taken the 
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MAS. Although the numbers were small, 
an r,, of .g1 was obtained. Practice effect, 
due to sub-test similarity, and long stand- 
ing patient-examiner relationship were 
undoubtedly reflected in the coefficient. 
Larger groups must be used before the 
above findings can be accepted with con- 
fidence. 

The third point needs little discussion. 
None of the r,ys are extremely high, but 
most of them indicate the presence of a 
marked relationship. Every clinician 
knows that the sub-tests of a diagnostic 
measure should bear as little relationship 
to one another as possible without sacri- 
ficing validity and reliability. 

From this standpoint, it will also be of 
interest to consider the intercorrelations 
of the screening device sub-tests, The re- 
sults of these computations are shown in 
Table 21. None of the intercorrelations 
for the control group are significant at 
the 1% level, except that for the two 
parts of the Memory test. However, a 
marked correlation between the scores 
obtained by brain injured patients on 
certain sub-tests should be noted. Specifi- 
cally, the relationship must be considered 
between the Patch test and the Trail 
Making Test and the relationship be- 
tween parts A and B of the Trail Making. 
It will be noted also that insignificant 
correlations were found for the control 
patients on these tests. 

It has been pointed out earlier in the 
paper that a highly significant difference 
was found between the mean scores for 
brain injured and control patients on 
these tests. This difference was explained 
primarily on the basis of clinical observa- 
tions of the difficulty encountered by the 
brain injured patients in planning, antic- 
ipation, and coping with a dual rela- 
tionship seemingly necessary for success- 
ful performance. These difficulties were 
not observed to any marked degree in 
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the control groups. Inasmuch as common 
difficulties contribute to greatly lowered 
scores for the brain injured persons on 
each of these tests, we believe that 
an explanation of the relationships be- 
tween the scores is offered. It may be 
argued that this is not a satisfactory ex- 
planation inasmuch as it might just as 
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ing to consider the relationship between 
these scores and those on other tests con- 
sidered similar in nature. The correla- 
tions between the sub-tests of the screen- 
ing device and the sub-tests of the MAS 
are presented in Table 22. It will be 
noted that in general the correlations are 
insignificant. It has been previously 


TABLE 21 
Intercorrelations among screening measure sub-tests 
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easily be expected ‘that controls have 
abilities necessary for successful perform- 
ance and therefore should also reveal a 
relationship. Of course the factor of in- 
dividual differences undoubtedly plays a 
large part in reducing the relationship of 
these scores for the controls, and is also 
probably a factor in the accounting for 
the correlation for the brain injured per- 
sons. We can only assume that changes 
resulting from brain injury impair per- 
formance in the respects necessary on 
these tests to the extent that low scores 
on each show less variance. 

Inasmuch as significant correlations 
found between the Patch test, Trail Mak- 
ing test and parts A and B of this test, 
have been explained on the basis of im- 
pairment of abilities necessary for suc- 
cessful performance, it will be interest- 


pointed out that Object Assembly and 
Block Design required the use of plan- 
ning and anticipation. The Trail Mak- 
ing and Patch tests, also requiring these 
abilities, show significant correlations 
with the MAS sub-tests. This may be con- 
sidered suggestive evidence supporting 
our explanation that the relationship is 
present because brain injury causes im- 
pairment which may reduce the degree of 
individual differences in the perform- 
ance of certain tests. 

Note the low correlation between the 
Memory test and the Digit Span. It is 
obvious that they are not measures of 
the same function, at least for the brain 
injured patients. It has been suggested 
(23) and supporting evidence has been 
offered (1) that the Digit Span test pri- 
marily measures attention. 
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D. CRITIQUE OF THE SCREENING TEST 

The comparative results of each sub- 
test have been considered. The question 
now arises, does the measure meet the 


patients refused to allow the pieces to 
be put away until every design had been 
completed to their satisfaction. Three of 
the brain injured patients asked one of 
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Key—For an N of 44 an rxy of .384 is necessary for significance at the one per cent level. 


requirements for a screening test that 
were previously established? These will 
be discussed in the order previously 
given. 

(1) Test must be short. The average 
time taken to administer the test was 


the examiners if extra sets of the test 
were available as they wanted to “try 
them on their friends”. 

In the experience of the. examiners, 
rarely has a test proved to be as interest- 
ing. Not a single instance of rejection 
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Screening sub-test validities 
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25.6 minutes, with a range of from 16 to 
38 minutes. The examiners have on occa- 
sion given 10 tests within an eight hour 
period. 

(2) Interesting. Each part of the test 
seemed to catch and hold the interest of 
the patients. Those that were relatively 
uninteresting, the Trail Making and 
Goldstein-Scheerer Cubes, were either 
preceded by a test of intense interest or 
were accomplished so rapidly that little 
opportunity was present to develop any 
degree of dislike. The Patch test devel- 
oped such enthusiasm that frequently the 


occurred nor was such a tendency noted. 
Co-operation, effort and motivation were 
considered optimum in every case. 

(3) Easy. In general all the sub-tests 
but Trail Making were so constructed 
that the brain injured patient was able 
to exhibit successful performance on at 
least the initial parts of the test. The 
method of dealing with failure on the 
Trail Making test has already been dis- 
cussed. With the exception of the per- 
formance of both groups on the fore- 
going test, the scores were well distrib- 
uted. 
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(4) Relatively unaffected by neurotic 
trends. The results that were obtained 
suggested that the sub-tests used were not 
affected by neuroses. However, a larger 
group including all types of neurotic dis- 
orders must be tested to assure confidence 
in this respect, 

(5) Sample those functions that seem 
‘to suffer most as a result of brain injury. 
Not every field of possible impairment 
resulting from brain injury has yet been 
explored. However, the sub-tests seem 
to include a variety of those functions 
that appear to suffer most heavily. 

(6) Understandability. Over half of the 
brain injured and control cases were 
asked what they considered the purpose 
of each sub-test to be. Each of them had 
some definite logical idea as to the ra- 
tionale involved. In addition, all spon- 
taneous comments were recorded and ap- 
proximately thirty per cent of all the 
brain injured patients felt that this was 
the first sensible test that they had been 
required to take and none of them were 
of a derogatory nature. This may be 
compared to the, “I don’t know what 
good this test is going to do me” attitude 
that some of the MAS and W-B sub-tests 
aroused. 

(7) Have a minimum dependence on 
previously learned material. The Trail 
Making test is the only one that would 
seem to have any relation to “old learn- 
ing”. Numbers (the sequence, one, two, 
three) and the alphabet have been 
familiar to most since childhood. This 
may partially account for the correla- 
tions exhibited between Trail Making 
and Vocabulary, Information and Arith- 
metic sub-tests (Table 22). In relation to 
this point it should be noted that all 
other sub-test correlations are extremely 
low. 

(8) Performance items should be in- 
cluded. Three of the five sub-tests re- 


quire the patient to work with his hands 
and the others require verbalization, It 
is felt that an ample sample of the pa- 
tient’s behavior is obtained through the 
administration of the screening test. 

(9) Validity. At numerous points 
throughout the paper the subject of 
validity has been considered. It is admit- 
ted that at best only a partial validity 
can be determined from the obtained 
data. The r,,, coefficients that were com- 
puted are shown in Table 23. The col- 
umn headed “groups” denotes the com- 
position of the total group used. That is, 
total controls plus the brain injured 
comprised the first category used. In 
every instance a marked relationship 
was indicated between the no brain in- 
jury category and high scores on the sub- 
tests. These findings may be compared 
with the results given in Table 4. The 
relationship appears to be most marked 
for the “normals” and least marked for 
the “neurotics”. Finally, biserial coeffi- 
cients were determined for all sub-tests 
with a group composed of neurotics and 
normals. The correlations were all so 
small that they could not be considered 
significantly greater than zero, the largest 
being .21. How a group of psychotics or 
mental deficients would compare still re- 
mains to be answered. Until these and 
other comparative results can be ob- 
tained the true validity of the scale will 
not be known. 

(10) The test should be reliable. The 
reader is referred to work already accom- 
plished (4). 

(11) Directions should be simple, clear 
and easily understood. Demonstration 
items, samples, and carefully worded di- 
rections prevented any failures that 
might have been attributed to hazy or 
unclear explanations. Very few of the 
patients in either group asked for added 
information and none of the failures re- 
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flected the lack of understanding of what 
was required. 

(12) All performance tests should be of 
such nature that they can be accom- 
plished by gross muscular movements. It 
has been determined that with only one 
functioning hand every test can be ac- 
complished within the range of normal 
performance. Of all the sub-tests the 
Trail Making offered the greatest amount 
of difficulty to the patient who had the 
usé of only one hand. This difficulty 
could be overcome by fastening two 
copies of the test, one with the sample 
and. the other with the test side up, to 
the desk top with scotch tape. The loss 
of the use of the preferred hand is an 
additional aspect that must be consid- 
ered. Only two such cases were found and 
in each instance the performance fell 
within the normal range. 

In addition to these twelve points is 
the consideration that in its present form 


the test is not suitable for use unless the 
examiner has had considerable clinical 
experience. There has been no attempt 
made to obtain a final or total score 
which might be fitted into such cate- 
gories as: Normal, slightly less normal, 
relatively suspicious, etc. This procedure 
appears to be frequently misleading. The 
screening test has been designed so that 
both the quantitative and qualitative as- 
pects can be evaluated. In short, it is 
aimed at sampling behavior and the 
total performance exhibited by the brain 
damaged patient. Such considerations 
are difficult to reduce to a numerical 
score which can be readily categorized. 
Finally, the groups used in this study 
were all limited numerically. Further 
work must be carried out with this test 
or others of a similar nature. Norms 
based on groups as small as were con- 
sidered can often be misleading despite 
the most exacting statistical analysis. 





VI. SUMMARY AND CONCLUSIONS 


1. Four tests previously used to deter- 
mine the presence of brain injury were 
considered in terms of their comparative 
advantages, disadvantages, and rational. 
These tests were the MAS, Shipley, Hunt 
and Rorschach. It is suggested that the 
Rorschach is the most useful for this 
purpose, The value of the measure arises 
from its ability to tap many aspects of 
the individual personality untouched by 
the other three. Inasmuch as the under- 
standing of the brain injured patient 
does not lie alone in an inventory of in- 
tellectual functions, the wider scope of 
this test becomes doubly important. 

2. The need for a screening device was 
stressed. Regardless of the ultimate value 
of all of the above measures each had 
certain disadvantages as a preliminary 


or screening test. 

3. A five sub-test screening measure 
was proposed. It consisted of the Mem- 
ory, Trail Making and Patch sub-tests 
from the AIT, the \Goldstein-Scheerer 
Cube test, and the Stanford-Binet vocab- 


ulary. These were chosen as they seemed 
to test the following functions; (1) recent 
memory, (2) abstraction ability (analysis 
and synthesis), (3) ability to deal effec- 
tively with a dual relationship, (4) ability 
to plan and anticipate, (5) perseverative 
trends, and (6) the ability to shift. Tests 
measuring specific functions were se- 
lected because previous studies (1,2) had 
suggested that they were retarded by the 
presence of post-traumatic brain injury. 

4. The administration of the screening 
test to a group of definite brain injured 
and control patients (normals and neu- 
rotics) indicated definite quantitative 
and qualitative variance. Whether these 
obtained differences are to be considered 
characteristic of only post-traumatic 
brain injury could not be determined. 
Further validation either with this test 
or measures of a similar nature, using 
larger groups and including other per- 
sonality variants, must be accomplished 
before this point can be resolved with 
any assurance, 
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